00000001:02000400:3.0F:1787367268.405013:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787367289.473989:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787367291.466353:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 551 MB/s 00000001:01000000:1.0F:1787367291.716495:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 763 MB/s 00000001:01000000:2.0F:1787367291.966322:0:3249:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3959 MB/s 00000020:02000000:3.0:1787367292.835361:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_45_gb800aec 00000400:02000000:0.0:1787367293.765913:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.123@tcp [8/256/0/180] 00008000:02000000:3.0:1787367296.918066:0:3443:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787367346.844335:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787367357.972167:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787367357.972175:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787367357.973262:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001133a0d0 00000080:02000400:3.0:1787367357.973280:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787367357.980488:0:5822:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787367357.980505:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787367357.980548:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000eeceac64) 00000020:00000080:3.0:1787367357.980572:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787367358.009522:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787367358.010422:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787367358.040404:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787367358.040449:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787367358.040471:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787367358.040521:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787367358.040548:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787367358.040918:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787367358.040926:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787367358.040938:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f33b6 00000020:01000004:0.0:1787367358.040945:0:5822:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787367358.040950:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787367358.040955:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001133a0d0 from MGS 00000020:01000004:0.0:1787367358.040959:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787367358.040978:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e4f263c7) 00000020:00000080:0.0:1787367358.040989:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787367358.041104:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001133a0d0 from MGS, refs=2 00080000:01000000:0.0:1787367358.041110:0:5822:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787367358.041115:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f33c4 00000100:00100000:0.0:1787367358.041317:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787367358.041459:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787367358.041464:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787367358.041942:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787367358.041949:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787367358.042507:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367358.042876:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787367358.042880:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787367358.043458:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787367358.043465:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787367358.043983:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787367358.043990:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787367358.044785:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367358.044789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367358.044791:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367358.045133:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367358.045136:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367358.045143:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367358.045834:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787367358.049177:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787367358.296643:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4334 MB/s 00000001:01000000:0.0:1787367358.547556:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2988 MB/s 00000001:01000000:1.0:1787367358.798660:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 633 MB/s 00000001:01000000:2.0:1787367359.048640:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 507 MB/s 00080000:10000000:2.0:1787367359.065036:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787367359.107530:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787367359.116900:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787367359.116917:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787367359.116919:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787367359.123162:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787367359.127079:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787367359.128453:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787367359.128722:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787367359.128750:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787367359.129086:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367359.143963:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787367359.144003:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787367359.145768:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787367359.145779:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787367359.146628:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787367359.146635:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787367359.156859:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787367359.156887:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.123@tcp' 00000020:01000004:3.0:1787367359.156890:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787367359.156946:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.123@tcp (typ=mgc) 00000020:00000080:3.0:1787367359.156958:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.123@tcp (00000000ef619769) 00000020:00000080:3.0:1787367359.156976:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787367359.157117:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fd296cc6@MGC192.168.204.123@tcp: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1787367359.157719:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.123@tcp-0 is initialized 00000040:01000000:3.0:1787367359.157726:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787367359.158450:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787367359.165655:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787367359.166267:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.123@tcp (uuid 89d46cbb-4841-4af3-a474-32a0415d3217) 00000020:00000080:3.0:1787367359.166291:0:5822:0:(genops.c:1385:class_connect()) connect: client 89d46cbb-4841-4af3-a474-32a0415d3217, cookie 0xcbf1f1bac53f33d2 00000100:00080000:3.0:1787367359.166313:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787367359.166319:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.204.123@tcp: import 00000000fd296cc6 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367359.166381:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8780fdf x1874190446624896/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787367359.166417:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 89d46cbb-4841-4af3-a474-32a0415d3217->MGS 00000020:01000004:3.0:1787367359.166437:0:5822:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787367359.166462:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787367359.166476:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000aa95d6c7) 00000020:00000080:3.0:1787367359.166486:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787367359.166677:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8780fdf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89d46cbb-4841-4af3-a474-32a0415d3217:3309:1874190446624896:0@lo:250: 00000100:00100000:0.0:1787367359.166780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367359.173881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446624896 00000100:00100000:1.0:1787367359.173897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446624896 00000100:00100000:1.0:1787367359.173964:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367359.173971:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c75e25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874190446624896:12345-0@lo:250: 00010000:00080000:1.0:1787367359.174011:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 89d46cbb-4841-4af3-a474-32a0415d3217@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1787367359.174041:0:5834:0:(genops.c:1385:class_connect()) connect: client 89d46cbb-4841-4af3-a474-32a0415d3217, cookie 0xcbf1f1bac53f33e0 00000100:00080000:1.0:1787367359.174218:0:5834:0:(import.c:65:import_set_state_nolock()) 000000001232cc28 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367359.174303:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c75e25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+5:3309:x1874190446624896:12345-0@lo:250: Request processed in 331us (7523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367359.174310:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367359.174357:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787367359.174367:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1787367359.174374:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787367359.174379:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787367359.174382:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000fd296cc6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787367359.174385:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787367359.174396:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787367359.174400:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8780fdf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89d46cbb-4841-4af3-a474-32a0415d3217:3309:1874190446624896:0@lo:250: 00000100:00100000:3.0:1787367359.195276:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367359.196764:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787367359.196772:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787367359.199937:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787367359.199953:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787367359.201110:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787367359.201120:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787367359.202527:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367359.202784:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787367359.202790:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787367359.207110:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787367359.207426:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787367359.265233:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367359.265459:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787367359.265465:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787367359.267310:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787367359.267320:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787367359.268596:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367359.268886:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787367359.268893:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787367359.270091:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787367359.270103:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787367359.271053:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367359.271496:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787367359.271502:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787367359.272050:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787367359.272057:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787367359.273060:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367359.273520:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787367359.273526:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787367359.274037:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787367359.274043:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787367359.335930:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367359.337318:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787367359.337460:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787367359.342681:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787367359.342695:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787367359.352705:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787367359.354626:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787367359.355679:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787367359.355700:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787367359.355706:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787367359.355839:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787367359.355872:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787367359.355877:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787367359.355879:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367359.355880:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367359.355881:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367359.355883:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367359.355884:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367359.355885:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367359.355887:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367359.355888:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367359.355889:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367359.355891:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367359.355892:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367359.355895:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787367359.355897:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367359.355898:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367359.355900:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367359.355901:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367359.355902:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367359.355903:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367359.355904:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367359.355905:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367359.355906:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367359.355907:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367359.355908:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367359.355909:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367359.355947:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787367359.355965:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ea18d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625024:0@lo:253: 00000100:00100000:1.0:1787367359.356055:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367359.356127:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041a81898 going to sleep for 11 seconds 00000100:00100000:3.0:1787367359.356722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625024 00000100:00100000:3.0:1787367359.356729:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625024 00000100:00100000:3.0:1787367359.356772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367359.356780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032ccc54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+5:5822:x1874190446625024:12345-0@lo:253: 20000000:01000000:3.0:1787367359.356825:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787367359.356828:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787367359.357152:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787367359.357289:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787367359.357734:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367359.358956:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787367359.360900:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787367359.360907:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787367359.360915:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787367359.360918:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787367359.360935:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787367359.361695:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367359.361927:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787367359.361940:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787367359.361995:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787367359.362037:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787367359.362067:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787367359.364864:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787367359.364885:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787367359.364953:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787367359.364961:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787367359.365010:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787367359.365020:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787367359.365050:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787367359.365097:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787367359.365158:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787367359.365164:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787367359.365177:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367359.365445:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787367359.365454:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787367359.365483:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787367359.365509:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787367359.365562:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787367359.365574:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787367359.365645:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787367359.365653:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787367359.365694:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787367359.365730:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787367359.365763:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787367359.365774:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787367359.365849:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787367359.365857:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787367359.365887:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787367359.365920:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787367359.366105:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787367359.366155:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787367359.366163:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787367359.367848:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787367359.368186:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787367359.368249:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.123@tcp for mdt 20000000:01000000:2.0:1787367359.368251:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:2.0:1787367359.368291:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787367359.368299:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787367359.368343:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787367359.368351:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:2.0:1787367359.368422:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787367359.368433:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787367359.368466:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787367359.368502:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787367359.368568:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787367359.368572:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787367359.368576:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787367359.368586:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787367359.368597:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787367359.368628:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787367359.368631:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787367359.373354:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787367359.373957:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787367359.374017:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787367359.374051:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787367359.374063:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787367359.374065:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787367359.374877:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787367359.375092:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787367359.375746:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787367359.375828:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787367359.375843:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787367359.375845:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787367359.375850:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787367359.375852:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787367359.375857:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787367359.375863:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787367359.384305:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787367359.384610:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787367359.398046:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787367359.398093:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787367359.398578:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787367359.398601:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787367359.398622:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398639:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398649:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398655:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398661:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398667:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398672:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cfa3b01a already unused, calling callback (00000000acdee302) 00010000:00010000:0.0:1787367359.398675:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398681:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398692:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398928:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.398935:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfa3b01a/0xcbf1f1bac53f33e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787367359.398952:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787367359.717903:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032ccc54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+5:5822:x1874190446625024:12345-0@lo:253: Request processed in 361115us (361839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.717924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367359.718094:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ea18d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625024:0@lo:253: 10000000:01000000:1.0:1787367359.718108:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787367359.718122:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787367359.718124:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367359.718126:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367359.718127:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787367359.718128:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367359.718130:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367359.718131:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367359.718133:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367359.718134:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787367359.718135:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367359.718137:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787367359.718154:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001133a0d0 from lustre-MDT0000 10000000:01000000:1.0:1787367359.718179:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787367359.718182:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787367359.718186:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e8f9231cd28 10000000:01000000:1.0:1787367359.718219:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787367359.718227:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e8f9231cd28 from 1 10000000:01000000:1.0:1787367359.718230:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787367359.718265:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367359.718275:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367359.718282:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367359.718432:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ea18d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625152:0@lo:101: 00000100:00100000:1.0:1787367359.718534:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367359.718591:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000443ea3f8 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.718939:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625152 00000100:00100000:2.0:1787367359.718946:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625152 00000100:00100000:2.0:1787367359.719010:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367359.719019:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096666173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+5:5822:x1874190446625152:12345-0@lo:101: 00010000:00010000:2.0:1787367359.719030:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367359.719044:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034dee87c/0xcbf1f1bac53f33f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f33ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.719066:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034dee87c/0xcbf1f1bac53f33f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.719076:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034dee87c/0xcbf1f1bac53f33f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.719086:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034dee87c, rc 0) 00000100:00100000:2.0:1787367359.719226:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096666173 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+6:5822:x1874190446625152:12345-0@lo:101: Request processed in 209us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.719233:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367359.719377:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ea18d4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625152:0@lo:101: 00010000:00010000:0.0:1787367359.719390:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.719399:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367359.719467:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625280:0@lo:501: 00000100:00100000:0.0:1787367359.719496:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367359.719520:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000852bdc85 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.719626:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625280 00000100:00100000:2.0:1787367359.719637:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625280 00000100:00100000:2.0:1787367359.719670:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367359.719677:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1d61f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+6:5822:x1874190446625280:12345-0@lo:501: 00000100:00100000:2.0:1787367359.719899:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1d61f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+6:5822:x1874190446625280:12345-0@lo:501: Request processed in 223us (402us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787367359.719906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367359.720086:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625280:0@lo:501: 10000000:01000000:0.0:1787367359.720109:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787367359.720189:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720223:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000049a4eda/0xcbf1f1bac53f33ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367359.720231:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8f92200800 10000000:01000000:0.0:1787367359.720235:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367359.720245:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e8f92200800 10000000:01000000:0.0:1787367359.720247:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787367359.720250:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e8f92200800 from 1 10000000:01000000:0.0:1787367359.720252:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787367359.720272:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720278:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720285:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367359.720404:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625408:0@lo:101: 00000100:00100000:0.0:1787367359.720434:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367359.720514:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000852bdc85 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.720568:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625408 00000100:00100000:2.0:1787367359.720573:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625408 00000100:00100000:2.0:1787367359.720603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367359.720609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cdc701c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+6:5822:x1874190446625408:12345-0@lo:101: 00010000:00010000:2.0:1787367359.720617:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367359.720628:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001447c8fc/0xcbf1f1bac53f3403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f33fc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.720644:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001447c8fc/0xcbf1f1bac53f3403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f33fc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.720651:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001447c8fc/0xcbf1f1bac53f3403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f33fc expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.720658:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001447c8fc, rc 0) 00000100:00100000:2.0:1787367359.720694:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cdc701c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+7:5822:x1874190446625408:12345-0@lo:101: Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.720700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367359.720809:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625408:0@lo:101: 00010000:00010000:0.0:1787367359.720819:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720826:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367359.720906:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787367359.720919:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720926:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000cfa3b01a/0xcbf1f1bac53f33fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367359.720943:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787367359.720947:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367359.720951:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e8f92200800 10000000:01000000:0.0:1787367359.720953:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787367359.720956:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787367359.720958:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787367359.720983:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720989:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367359.720996:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367359.721007:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625536:0@lo:101: 00000100:00100000:0.0:1787367359.721034:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367359.721057:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000852bdc85 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.721216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625536 00000100:00100000:2.0:1787367359.721220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625536 00000100:00100000:2.0:1787367359.721251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367359.721257:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000096a12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+7:5822:x1874190446625536:12345-0@lo:101: 00010000:00010000:2.0:1787367359.721264:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367359.721279:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016bd81e4/0xcbf1f1bac53f3411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f340a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.721291:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016bd81e4/0xcbf1f1bac53f3411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.721368:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016bd81e4/0xcbf1f1bac53f3411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367359.721374:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016bd81e4, rc 0) 00000100:00100000:2.0:1787367359.721458:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000096a12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+8:5822:x1874190446625536:12345-0@lo:101: Request processed in 201us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.721465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367359.721711:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff9383a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625536:0@lo:101: 00010000:00010000:1.0:1787367359.721722:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367359.721729:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367359.721775:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625664:0@lo:501: 00000100:00100000:1.0:1787367359.721801:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367359.721926:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000443ea3f8 going to sleep for 11 seconds 00000100:00100000:3.0:1787367359.721964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625664 00000100:00100000:3.0:1787367359.721978:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625664 00000100:00100000:3.0:1787367359.722048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367359.722054:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ba63df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+8:5822:x1874190446625664:12345-0@lo:501: 00000100:00100000:3.0:1787367359.722468:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ba63df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+9:5822:x1874190446625664:12345-0@lo:501: Request processed in 414us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367359.722475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367359.722540:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625664:0@lo:501: 00000100:00100000:1.0:1787367359.722565:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625792:0@lo:503: 00000100:00100000:1.0:1787367359.722600:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367359.722767:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000443ea3f8 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.722900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625792 00000100:00100000:2.0:1787367359.722905:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625792 00000100:00100000:2.0:1787367359.722924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367359.722928:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e5a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+9:5822:x1874190446625792:12345-0@lo:503: 00000100:00100000:2.0:1787367359.723075:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e5a35c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+9:5822:x1874190446625792:12345-0@lo:503: Request processed in 146us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.723081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367359.723188:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446625792:0@lo:503: 00000100:00100000:3.0:1787367359.723743:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f41d159c pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5865:1874190446625920:0@lo:502: 00000100:00100000:3.0:1787367359.723777:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367359.723887:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da8d8e55 going to sleep for 11 seconds 00000100:00100000:2.0:1787367359.723918:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446625920 00000100:00100000:2.0:1787367359.723921:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446625920 00000100:00100000:2.0:1787367359.723982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367359.723989:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b1dcae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+9:5865:x1874190446625920:12345-0@lo:502: 00000100:00100000:2.0:1787367359.724225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b1dcae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+9:5865:x1874190446625920:12345-0@lo:502: Request processed in 237us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367359.724232:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367359.724387:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f41d159c pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5865:1874190446625920:0@lo:502: 00000020:01000000:0.0:1787367359.724408:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367359.724418:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367359.724420:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787367359.724424:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787367359.724427:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367359.724438:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c061604d) 00000020:00000080:0.0:1787367359.724510:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787367359.724516:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787367359.724585:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787367359.724599:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f341f 00000020:00000080:0.0:1787367359.724806:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787367359.724810:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367359.724813:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367359.724814:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787367359.724816:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367359.724819:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367359.724820:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787367359.724823:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367359.724829:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000066ed3c5a) 00000020:00000080:0.0:1787367359.724897:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787367359.724902:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787367359.724903:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787367359.724906:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787367359.724911:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787367359.724948:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001133a0d0 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787367359.724957:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000ef56714) 00000020:00000080:0.0:1787367359.724963:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787367359.725014:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787367359.725027:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f3434 00000020:00000080:0.0:1787367359.725109:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787367359.725363:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787367359.725368:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbf1f1bac53f343b 00080000:01000000:0.0:1787367359.725373:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787367359.725376:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f3442 00080000:10000000:3.0:1787367359.726670:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787367359.726911:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787367359.732814:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787367359.847453:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787367359.849031:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787367359.855465:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787367359.856118:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787367359.909447:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007488ecc5) 00000020:00000080:0.0:1787367359.909470:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787367359.909544:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787367359.909551:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f3450 00000020:00000080:3.0:1787367359.914650:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787367359.918066:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367359.975815:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367360.000844:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367360.022322:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367360.056861:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367360.091906:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1787367360.131404:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787367360.134685:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbf1f1bac53f3457 00000020:00000080:1.0:1787367360.135357:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787367360.135368:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367360.135374:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367360.135376:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787367360.135379:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367360.135382:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367360.135384:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367360.135387:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367360.135388:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787367360.135396:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367360.135398:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367360.135400:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787367360.135402:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367360.135406:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367360.135407:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787367360.135411:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787367360.135509:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787367360.135561:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5865:1874190446626048:0@lo:502: 00000100:00100000:1.0:1787367360.135651:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367360.135751:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e06bf07c going to sleep for 11 seconds 00000100:00100000:2.0:1787367360.135825:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626048 00000100:00100000:2.0:1787367360.135832:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626048 00000100:00100000:2.0:1787367360.135910:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787367360.135919:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893f2bae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+9:5865:x1874190446626048:12345-0@lo:502: 00000100:00100000:2.0:1787367360.136334:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893f2bae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+9:5865:x1874190446626048:12345-0@lo:502: Request processed in 416us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367360.136342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787367360.136425:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5865:1874190446626048:0@lo:502: 00000020:01000000:1.0:1787367360.136574:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367360.136579:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367360.136581:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787367360.136585:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787367360.136695:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787367360.136714:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787367360.136729:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.136739:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 0000000007a94b4b/0xcbf1f1bac53f340a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367360.136747:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8f92200800 from 1 10000000:01000000:1.0:1787367360.136750:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787367360.136773:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.136779:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.136795:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367360.136807:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626176:0@lo:101: 00000100:00100000:1.0:1787367360.136834:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367360.137112:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e06bf07c going to sleep for 11 seconds 00000100:00100000:3.0:1787367360.137349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626176 00000100:00100000:3.0:1787367360.137355:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626176 00000100:00100000:1.0:1787367360.137433:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367360.137449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000314b12fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+9:5822:x1874190446626176:12345-0@lo:101: 00010000:00010000:1.0:1787367360.137460:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367360.137473:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f345e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.137495:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.137504:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.137512:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032853e51, rc 0) 00000100:00100000:1.0:1787367360.137551:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000314b12fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:5822:x1874190446626176:12345-0@lo:101: Request processed in 103us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367360.137558:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367360.137688:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd6fc0f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626176:0@lo:101: 00010000:00010000:3.0:1787367360.137701:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.137708:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367360.138297:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626304:0@lo:256: 00000100:00100000:3.0:1787367360.138341:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.138361:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dc161ab going to sleep for 11 seconds 00000100:00100000:1.0:1787367360.138536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626304 00000100:00100000:1.0:1787367360.138542:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626304 00000100:00100000:1.0:1787367360.138565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787367360.138572:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cfb6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:5822:x1874190446626304:12345-0@lo:256: 20000000:01000000:1.0:1787367360.138587:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787367360.138600:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787367360.138671:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cfb6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:5822:x1874190446626304:12345-0@lo:256: Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367360.138678:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367360.138745:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626304:0@lo:256: 10000000:01000000:3.0:1787367360.139358:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367360.139372:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.139381:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367360.139388:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92200800 from 1 10000000:01000000:3.0:1787367360.139391:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367360.139416:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.139423:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.139430:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367360.139634:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626432:0@lo:101: 00000100:00100000:3.0:1787367360.139671:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.139794:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dc161ab going to sleep for 11 seconds 00000100:00100000:2.0:1787367360.140012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626432 00000100:00100000:2.0:1787367360.140020:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626432 00000100:00100000:2.0:1787367360.140048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367360.140054:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bf981b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+10:5822:x1874190446626432:12345-0@lo:101: 00010000:00010000:2.0:1787367360.140064:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367360.140077:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f346c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.140095:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.140117:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.140124:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de64b508, rc 0) 00000100:00100000:2.0:1787367360.140168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bf981b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626432:12345-0@lo:101: Request processed in 114us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367360.140175:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787367360.140275:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626432:0@lo:101: 00010000:00010000:3.0:1787367360.140286:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.140294:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367360.140341:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626560:0@lo:501: 00000100:00100000:3.0:1787367360.140367:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.140394:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dc161ab going to sleep for 11 seconds 00000100:00100000:2.0:1787367360.140455:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626560 00000100:00100000:2.0:1787367360.140460:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626560 00000100:00100000:2.0:1787367360.140477:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367360.140482:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e837407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626560:12345-0@lo:501: 00000100:00100000:2.0:1787367360.141006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e837407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626560:12345-0@lo:501: Request processed in 523us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367360.141014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367360.141186:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626560:0@lo:501: 00000100:00100000:3.0:1787367360.141244:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626688:0@lo:503: 00000100:00100000:3.0:1787367360.141280:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.141291:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dc161ab going to sleep for 11 seconds 00000100:00100000:2.0:1787367360.141421:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626688 00000100:00100000:2.0:1787367360.141425:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626688 00000100:00100000:2.0:1787367360.141457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367360.141462:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e57f78ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626688:12345-0@lo:503: 00000040:00080000:2.0:1787367360.141495:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367360.141537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e57f78ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626688:12345-0@lo:503: Request processed in 74us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367360.141544:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367360.141664:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626688:0@lo:503: 00000040:00080000:3.0:1787367360.142735:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787367360.142845:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787367360.142861:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367360.142876:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.142885:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367360.142927:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787367360.142929:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8f92200800 10000000:01000000:2.0:1787367360.142932:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8f92200800 10000000:01000000:2.0:1787367360.142935:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787367360.142941:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f92200800 from 1 10000000:01000000:2.0:1787367360.142943:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367360.142993:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.143001:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.143015:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367360.143032:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626816:0@lo:101: 00000100:00100000:2.0:1787367360.143078:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367360.143119:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048d647e9 going to sleep for 11 seconds 00000100:00100000:3.0:1787367360.143295:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626816 00000100:00100000:3.0:1787367360.143301:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626816 00000100:00100000:3.0:1787367360.143339:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367360.143346:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3a1023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446626816:12345-0@lo:101: 00010000:00010000:3.0:1787367360.143357:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367360.143369:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008f796abe/0xcbf1f1bac53f3481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f347a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.143395:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f796abe/0xcbf1f1bac53f3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.143406:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008f796abe/0xcbf1f1bac53f3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.143414:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008f796abe, rc 0) 00000100:00100000:3.0:1787367360.143552:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3a1023 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446626816:12345-0@lo:101: Request processed in 207us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367360.143558:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367360.143634:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626816:0@lo:101: 00010000:00010000:2.0:1787367360.143646:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367360.143654:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367360.143693:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626944:0@lo:501: 00000100:00100000:2.0:1787367360.143719:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367360.143746:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048d647e9 going to sleep for 11 seconds 00000100:00100000:3.0:1787367360.144540:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446626944 00000100:00100000:3.0:1787367360.144547:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446626944 00000100:00100000:3.0:1787367360.144575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367360.144582:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000778dcf10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446626944:12345-0@lo:501: 00000100:00100000:3.0:1787367360.144839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000778dcf10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446626944:12345-0@lo:501: Request processed in 257us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367360.144846:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787367360.144989:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446626944:0@lo:501: 00000100:00100000:2.0:1787367360.145022:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446627072:0@lo:503: 00000100:00100000:2.0:1787367360.145061:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367360.145081:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048d647e9 going to sleep for 11 seconds 00000100:00100000:3.0:1787367360.145539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627072 00000100:00100000:3.0:1787367360.145545:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627072 00000100:00100000:3.0:1787367360.145582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367360.145589:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000908df5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446627072:12345-0@lo:503: 00000100:00100000:3.0:1787367360.145884:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000908df5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446627072:12345-0@lo:503: Request processed in 295us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367360.145890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787367360.146229:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446627072:0@lo:503: 00000100:00100000:2.0:1787367360.147031:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5870:1874190446627200:0@lo:502: 00000100:00100000:2.0:1787367360.147083:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367360.147237:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a26add05 going to sleep for 11 seconds 00000100:00100000:3.0:1787367360.147356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627200 00000100:00100000:3.0:1787367360.147362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627200 00000100:00100000:0.0:1787367360.147556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367360.147564:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b3d492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5870:x1874190446627200:12345-0@lo:502: 00000100:00100000:0.0:1787367360.147813:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b3d492 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5870:x1874190446627200:12345-0@lo:502: Request processed in 249us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367360.147827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787367360.147889:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9b8de83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5870:1874190446627200:0@lo:502: 00000020:01000004:2.0:1787367360.147948:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787367360.147979:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000099a7bbf3) 00000020:00000080:2.0:1787367360.147998:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787367360.148083:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001133a0d0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787367360.148087:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001133a0d0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787367360.148089:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001133a0d0 4 00010000:00080000:2.0:1787367360.148125:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008fdcdd7f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1787367360.149894:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787367360.150146:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787367360.150178:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787367360.150211:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbf1f1bac53f348f 00000100:00080000:3.0:1787367360.150221:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787367360.150226:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008fdcdd7f using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367360.150256:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005b5ea8ea x1874190446627328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367360.150291:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446627328:0@lo:38: 00000100:00100000:3.0:1787367360.150351:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.150407:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627328 00000100:00100000:3.0:1787367360.150413:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627328 00000100:00100000:3.0:1787367360.150440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367360.150446:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ce6dbfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874190446627328:12345-0@lo:38: 00000100:00100000:3.0:1787367360.150491:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ce6dbfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874190446627328:12345-0@lo:38: Request processed in 44us (140us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787367360.150497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367360.150530:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367360.150536:0:3309:0:(import.c:65:import_set_state_nolock()) 000000008fdcdd7f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367360.150550:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787367360.150552:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446627328:0@lo:38: 00000100:00080000:3.0:1787367360.150578:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787367360.151618:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5870:1874190446627456:0@lo:502: 00000100:00100000:3.0:1787367360.151671:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.151706:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db312ba1 going to sleep for 11 seconds 00000100:00100000:1.0:1787367360.152549:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627456 00000100:00100000:1.0:1787367360.152557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627456 00000100:00100000:1.0:1787367360.152593:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367360.152600:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045cc7534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5870:x1874190446627456:12345-0@lo:502: 00000100:00100000:1.0:1787367360.152836:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045cc7534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5870:x1874190446627456:12345-0@lo:502: Request processed in 236us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367360.152843:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787367360.153248:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:5870:1874190446627456:0@lo:502: 00000040:00080000:3.0:1787367360.153278:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787367360.154164:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787367360.154185:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787367360.154224:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367360.154235:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000d15d6355/0xcbf1f1bac53f347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787367360.154278:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787367360.154281:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367360.154282:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367360.154283:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367360.154284:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367360.154286:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367360.154287:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367360.154288:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367360.154289:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367360.154291:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367360.154292:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367360.154293:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367360.154297:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787367360.154299:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367360.154304:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367360.154305:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367360.154305:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367360.154306:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367360.154307:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367360.154308:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367360.154308:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367360.154309:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367360.154310:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367360.154310:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367360.154311:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367360.154329:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787367360.154343:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f48a332 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446627584:0@lo:253: 00000100:00100000:1.0:1787367360.154401:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367360.154430:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093f9039d going to sleep for 11 seconds 00000100:00100000:0.0:1787367360.156259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627584 00000100:00100000:0.0:1787367360.156269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627584 00000100:00100000:0.0:1787367360.156317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367360.156325:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a25d172d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5822:x1874190446627584:12345-0@lo:253: 20000000:01000000:0.0:1787367360.156355:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787367360.156370:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787367360.183425:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787367360.183513:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787367360.183610:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787367360.183615:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787367360.183634:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.183652:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.183660:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.183700:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.183715:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 12 pid: 5834 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367360.183731:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446627712:0@lo:104: 00000100:00100000:3.0:1787367360.183813:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367360.183917:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029eaf567 going to sleep for 11 seconds 00000100:00100000:0.0:1787367360.183994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627712 00000100:00100000:0.0:1787367360.184001:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627712 00000100:00100000:0.0:1787367360.184051:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367360.184059:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7247a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446627712:12345-0@lo:104: 00010000:00010000:0.0:1787367360.184071:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184135:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367360.184141:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7247a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446627712:12345-0@lo:104: Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367360.184147:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787367360.184166:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367360.184171:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184178:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae7b50a2 already unused, calling callback (000000009e0afc63) 10000000:00010000:0.0:1787367360.184181:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184188:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367360.184217:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367360.184222:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367360.184249:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184255:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367360.184271:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184277:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 00000000ae7b50a2/0xcbf1f1bac53f345e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3465 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184291:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367360.184292:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367360.184294:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367360.184361:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446627840:0@lo:103: 00000100:00100000:0.0:1787367360.184389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367360.184560:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627840 00000100:00100000:0.0:1787367360.184565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627840 00010000:00010000:0.0:1787367360.184580:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 13 pid: 5834 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367360.184602:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367360.184607:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db75812f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+13:3311:x1874190446627840:12345-0@lo:103: 00010000:00010000:0.0:1787367360.184617:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367360.184622:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 13 pid: 5834 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184638:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 13 pid: 5834 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184653:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184659:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787367360.184673:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001057936s 00010000:00010000:0.0:1787367360.184676:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184683:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184689:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184694:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184699:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bde81f6 already unused, calling callback (00000000acdee302) 00010000:00010000:0.0:1787367360.184702:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184708:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184717:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367360.184735:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367360.184764:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db75812f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+13:3311:x1874190446627840:12345-0@lo:103: Request processed in 158us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367360.184771:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367360.184808:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446627840:0@lo:103: 00010000:00010000:3.0:1787367360.184889:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032853e51/0xcbf1f1bac53f3465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f345e expref: 12 pid: 5834 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367360.184899:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5ea8ea pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446627712:0@lo:104: 00010000:00010000:3.0:1787367360.184909:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.184916:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.184921:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367360.184932:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f3496 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367360.193598:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a25d172d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:5822:x1874190446627584:12345-0@lo:253: Request processed in 37265us (39189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367360.193614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367360.193697:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f48a332 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:5822:1874190446627584:0@lo:253: 10000000:01000000:1.0:1787367360.193713:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787367360.193716:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787367360.193718:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787367360.193720:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367360.193721:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367360.193722:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367360.193723:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367360.193724:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787367360.193726:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787367360.193727:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367360.193729:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367360.193730:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367360.193731:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787367360.193745:0:5822:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787367360.203747:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.204086:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367360.204389:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.204607:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367360.204800:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.204942:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367360.205713:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.205893:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367360.206066:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.206315:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367360.206549:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367360.206703:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787367360.241752:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787367360.269031:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787367360.269647:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1787367360.272138:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787367360.272145:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787367360.272872:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787367360.273014:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787367360.273679:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787367360.273686:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787367360.273793:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367360.275366:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787367360.275875:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787367360.275903:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787367360.276571:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787367360.276861:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787367360.278645:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787367360.278799:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787367360.278932:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787367360.279248:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787367360.279459:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787367360.279608:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787367360.279740:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787367360.279899:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787367360.280049:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787367360.283183:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787367360.283405:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787367360.283557:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787367360.286490:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787367360.286685:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787367360.286835:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787367360.287042:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787367360.287348:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787367360.287510:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787367360.287644:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787367360.287791:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787367360.287927:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787367360.288089:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787367360.288302:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787367360.288447:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787367360.288593:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787367360.288764:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787367360.295562:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787367360.295807:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787367360.295946:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787367360.296127:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787367360.301805:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787367360.302045:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787367360.302245:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787367360.356182:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787367360.536575:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787367360.536616:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4e1419df988 00100000:10000000:1.0:1787367360.536625:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787367360.538788:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787367360.538806:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787367360.538823:0:5822:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787367360.538846:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787367360.581571:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787367360.581642:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787367360.581646:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787367361.156840:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367362.179462:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367363.204617:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367364.237380:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367365.188767:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1787367365.188858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787367365.188873:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787367365.188877:0:37:0:(import.c:65:import_set_state_nolock()) 000000008fdcdd7f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367365.188894:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008fdcdd7f using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367365.188929:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e01861d5 x1874190446628096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367365.189070:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e01861d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446628096:0@lo:38: 00000100:00100000:3.0:1787367365.189167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367365.190891:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f48a332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446627968:0@lo:400: 00000100:00100000:2.0:1787367365.190984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367365.192501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446627968 00000100:00100000:3.0:1787367365.192523:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446627968 00000100:00100000:3.0:1787367365.192610:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367365.192620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf69d71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:3313:x1874190446627968:12345-0@lo:400: 00000100:00100000:3.0:1787367365.192744:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf69d71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:3313:x1874190446627968:12345-0@lo:400: Request processed in 124us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367365.192752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367365.192823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f48a332 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446627968:0@lo:400: 00000100:00100000:1.0:1787367365.193990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628096 00000100:00100000:1.0:1787367365.194002:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628096 00000100:00100000:1.0:1787367365.194050:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367365.194056:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b5ea8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874190446628096:12345-0@lo:38: 00010000:00080000:1.0:1787367365.194088:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1787367365.194130:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbf1f1bac53f349d 00000004:00100000:1.0:1787367365.194215:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787367365.194545:0:5843:0:(import.c:65:import_set_state_nolock()) 0000000012aa1ac6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367365.194690:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b5ea8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874190446628096:12345-0@lo:38: Request processed in 632us (5522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367365.194698:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787367365.194999:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e01861d5 x1874190446628096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787367365.195020:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787367365.195030:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787367365.195036:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787367365.195038:0:3309:0:(import.c:65:import_set_state_nolock()) 000000008fdcdd7f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787367365.195046:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e01861d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446628096:0@lo:38: 00010000:00010000:0.0:1787367365.252519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787367365.699327:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787367365.699442:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8f92200800 from 3 10000000:01000000:0.0:1787367365.699449:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787367365.699515:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367365.699531:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367365.699544:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367365.699575:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628224:0@lo:101: 00000100:00100000:0.0:1787367365.699674:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367365.699829:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000004db17522 going to sleep for 11 seconds 00000100:00100000:1.0:1787367365.700023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628224 00000100:00100000:1.0:1787367365.700034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628224 00000100:00100000:1.0:1787367365.700101:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367365.700111:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bab9f891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:5838:x1874190446628224:12345-0@lo:101: 00010000:00010000:1.0:1787367365.700129:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367365.700145:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ef58051/0xcbf1f1bac53f34ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f34a4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367365.700172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ef58051/0xcbf1f1bac53f34ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367365.700184:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ef58051/0xcbf1f1bac53f34ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367365.700208:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ef58051, rc 0) 00000100:00100000:1.0:1787367365.700261:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bab9f891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446628224:12345-0@lo:101: Request processed in 152us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367365.700280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367365.700890:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628224:0@lo:101: 00010000:00010000:0.0:1787367365.700911:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367365.700923:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367365.701055:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628352:0@lo:256: 00000100:00100000:0.0:1787367365.701102:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367365.701182:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000004db17522 going to sleep for 11 seconds 00000100:00100000:3.0:1787367365.713349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628352 00000100:00100000:3.0:1787367365.713375:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628352 00000100:00100000:3.0:1787367365.713472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367365.713484:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008e78b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446628352:12345-0@lo:256: 20000000:01000000:3.0:1787367365.713527:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787367365.713547:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787367365.713551:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787367365.713748:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008e78b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446628352:12345-0@lo:256: Request processed in 266us (12645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367365.713757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367365.713866:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bdfb7d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628352:0@lo:256: 10000000:01000000:3.0:1787367365.713928:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367365.713940:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367365.713953:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000005382a1c7/0xcbf1f1bac53f34a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367366.280671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367366.817460:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367367.301244:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367368.324222:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367369.348477:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367370.307654:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367370.307996:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0ac9bea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446628608:0@lo:400: 00000100:00100000:1.0:1787367370.308089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367370.308382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628608 00000100:00100000:2.0:1787367370.308390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628608 00000100:00100000:2.0:1787367370.308443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367370.308451:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbae6e09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446628608:12345-0@lo:400: 00000100:00100000:0.0:1787367370.308586:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a35b9b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446628480:0@lo:400: 00000100:00100000:0.0:1787367370.308622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367370.308898:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628480 00000100:00100000:3.0:1787367370.308912:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628480 00000100:00100000:3.0:1787367370.308945:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787367370.308950:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c20afbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:3312:x1874190446628480:12345-0@lo:400: 00000100:00100000:3.0:1787367370.308985:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c20afbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:3312:x1874190446628480:12345-0@lo:400: Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367370.308991:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367370.309319:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a35b9b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446628480:0@lo:400: 00000100:00100000:2.0:1787367370.310100:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbae6e09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446628608:12345-0@lo:400: Request processed in 1646us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367370.310110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787367370.312369:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f0ac9bea x1874190446628608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367370.312389:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0ac9bea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446628608:0@lo:400: 00010000:00010000:0.0:1787367370.373044:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367371.395565:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787367371.756666:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe99d5a240 20000000:00000080:1.0:1787367371.756681:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fa01e3400 uarg=0000000000000000 20000000:01000000:1.0:1787367371.756715:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787367371.756721:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787367371.756726:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787367371.756929:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787367371.756941:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787367371.762328:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367371.762587:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787367371.762644:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787367371.762692:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787367371.762710:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787367371.762727:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.762760:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.762768:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.762806:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.762822:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 11 pid: 5836 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367371.762837:0:6322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fcf3bef1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1874190446628736:0@lo:104: 00000100:00100000:0.0:1787367371.762916:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367371.763170:0:6322:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092369dfe going to sleep for 11 seconds 00000100:00100000:3.0:1787367371.763281:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628736 00000100:00100000:3.0:1787367371.763289:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628736 00000100:00100000:3.0:1787367371.763335:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367371.763342:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be75f7a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:6322:x1874190446628736:12345-0@lo:104: 00010000:00010000:3.0:1787367371.763354:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367371.764754:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367371.764764:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be75f7a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:6322:x1874190446628736:12345-0@lo:104: Request processed in 1419us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367371.764775:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787367371.764840:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367371.764847:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367371.764856:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001f90c6c9 already unused, calling callback (000000009e0afc63) 10000000:00010000:1.0:1787367371.764859:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367371.764866:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367371.764872:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367371.764943:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367371.765099:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367371.765106:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367371.765158:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787367371.765176:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367371.765182:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 000000001f90c6c9/0xcbf1f1bac53f346c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3473 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367371.765244:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367371.765246:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367371.765248:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367371.765411:0:6322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fcf3bef1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1874190446628736:0@lo:104: 00010000:00010000:0.0:1787367371.765433:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367371.765496:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009632e812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446628864:0@lo:103: 00000100:00100000:3.0:1787367371.765548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367371.765769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628864 00000100:00100000:0.0:1787367371.765775:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628864 00010000:00010000:0.0:1787367371.765798:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 12 pid: 5836 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367371.765859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367371.765867:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0495d89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+12:3310:x1874190446628864:12345-0@lo:103: 00010000:00010000:0.0:1787367371.765888:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367371.765892:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 12 pid: 5836 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765902:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 12 pid: 5836 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765916:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de64b508/0xcbf1f1bac53f3473 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f346c expref: 12 pid: 5836 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765929:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765935:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765947:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765952:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765965:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765970:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.765975:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000001aed230 already unused, calling callback (00000000acdee302) 00010000:00010000:0.0:1787367371.765978:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.766103:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.766125:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367371.766134:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367371.766178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0495d89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+11:3310:x1874190446628864:12345-0@lo:103: Request processed in 312us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367371.766185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367371.766340:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009632e812 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446628864:0@lo:103: 00010000:00010000:3.0:1787367371.766400:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367371.766408:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367371.766414:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001aed230/0xcbf1f1bac53f34b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367372.422709:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367373.445899:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367374.470680:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787367374.534847:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367374.534859:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92200800 from 1 10000000:01000000:3.0:1787367374.534865:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367374.534940:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000e956ebbe/0xcbf1f1bac53f34b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.534957:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000e956ebbe/0xcbf1f1bac53f34b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.535053:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000e956ebbe/0xcbf1f1bac53f34b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367374.535085:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628992:0@lo:101: 00000100:00100000:3.0:1787367374.546655:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367374.548291:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5737c23 going to sleep for 11 seconds 00000100:00100000:3.0:1787367374.548308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446628992 00000100:00100000:3.0:1787367374.548323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446628992 00000100:00100000:3.0:1787367374.548400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367374.548410:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041f6282f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:5838:x1874190446628992:12345-0@lo:101: 00010000:00010000:3.0:1787367374.548431:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367374.548456:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f34c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f34b9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.548494:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f34c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.548506:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bde81f6/0xcbf1f1bac53f34c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.548517:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bde81f6, rc 0) 00000100:00100000:3.0:1787367374.548611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041f6282f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446628992:12345-0@lo:101: Request processed in 203us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367374.548619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367374.548706:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446628992:0@lo:101: 00010000:00010000:3.0:1787367374.548724:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000e956ebbe/0xcbf1f1bac53f34b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367374.548735:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000e956ebbe/0xcbf1f1bac53f34b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367374.548820:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446629120:0@lo:501: 00000100:00100000:3.0:1787367374.548857:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367374.548905:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5737c23 going to sleep for 11 seconds 00000100:00100000:2.0:1787367374.549465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629120 00000100:00100000:2.0:1787367374.549473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629120 00000100:00100000:2.0:1787367374.549516:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367374.549523:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f82e87b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446629120:12345-0@lo:501: 00000100:00100000:2.0:1787367374.549880:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f82e87b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446629120:12345-0@lo:501: Request processed in 357us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367374.549888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787367374.551290:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446629120:0@lo:501: 00000100:00100000:3.0:1787367374.551360:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446629248:0@lo:503: 00000100:00100000:3.0:1787367374.551441:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367374.551480:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5737c23 going to sleep for 11 seconds 00000100:00100000:3.0:1787367374.551501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629248 00000100:00100000:3.0:1787367374.551507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629248 00000100:00100000:3.0:1787367374.551564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787367374.551573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000333a71ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446629248:12345-0@lo:503: 00000100:00100000:3.0:1787367374.551773:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000333a71ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446629248:12345-0@lo:503: Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367374.551781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787367374.551828:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000393002d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446629248:0@lo:503: 00000100:00100000:0.0:1787367374.553833:0:6434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fcf3bef1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6434:1874190446629376:0@lo:502: 00000100:00100000:0.0:1787367374.553936:0:6434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367374.553986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629376 00000100:00100000:0.0:1787367374.553994:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629376 00000100:00100000:0.0:1787367374.554223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367374.554235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d572b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6434:x1874190446629376:12345-0@lo:502: 00000100:00100000:0.0:1787367374.554912:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d572b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6434:x1874190446629376:12345-0@lo:502: Request processed in 675us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367374.554931:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367374.555011:0:6434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bad19cbe going to sleep for 11 seconds 00000100:00100000:0.0:1787367374.555101:0:6434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fcf3bef1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6434:1874190446629376:0@lo:502: 00000020:01000000:0.0:1787367374.555141:0:6434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367374.555154:0:6434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367374.555156:0:6434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787367374.555166:0:6434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f92200800 00000020:00000080:0.0:1787367374.555168:0:6434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787367374.555299:0:6434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6434:1874190446629504:0@lo:502: 00000100:00100000:0.0:1787367374.555344:0:6434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367374.555379:0:6434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787367374.557483:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629504 00000100:00100000:3.0:1787367374.557501:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629504 00000100:00100000:3.0:1787367374.557916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367374.557928:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:6434:x1874190446629504:12345-0@lo:502: 00000100:00100000:3.0:1787367374.558289:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:6434:x1874190446629504:12345-0@lo:502: Request processed in 362us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367374.558297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787367374.561721:0:6434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6434:1874190446629504:0@lo:502: 00000020:01000000:0.0:1787367374.561787:0:6434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367374.561802:0:6434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367374.561805:0:6434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787367374.561811:0:6434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787367374.561909:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787367374.561933:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367374.561960:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367374.561974:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367375.435933:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446629632:0@lo:400: 00000100:00100000:2.0:1787367375.436007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367375.436060:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367375.436067:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446629760:0@lo:400: 00000100:00100000:2.0:1787367375.436099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367375.436145:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629632 00000100:00100000:2.0:1787367375.436152:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629632 00000100:00100000:2.0:1787367375.436225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787367375.436236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:3312:x1874190446629632:12345-0@lo:400: 00000100:00100000:2.0:1787367375.436287:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:3312:x1874190446629632:12345-0@lo:400: Request processed in 52us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367375.436294:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787367375.436323:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629760 00000100:00100000:2.0:1787367375.436327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629760 00000100:00100000:2.0:1787367375.436349:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367375.436355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446629760:12345-0@lo:400: 00000100:00100000:2.0:1787367375.436382:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446629760:12345-0@lo:400: Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367375.436400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787367375.436436:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8f83f5f100 x1874190446629760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367375.436451:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446629760:0@lo:400: 00000100:00100000:2.0:1787367375.436462:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446629632:0@lo:400: 00010000:00010000:2.0:1787367375.492086:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367376.516489:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367377.539337:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787367378.053916:0:6693:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787367378.053920:0:6693:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787367378.054431:0:6693:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e8fb88be800 00000020:01000004:1.0:1787367378.054448:0:6693:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787367378.054461:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787367378.054487:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e8fafceb370) 00000020:00000080:1.0:1787367378.054505:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787367378.100301:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787367378.100545:0:6693:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787367378.148580:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787367378.163923:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787367378.165326:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787367378.165409:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787367378.165435:0:6693:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787367378.165772:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787367378.165782:0:6693:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787367378.165792:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbf1f1bac53f34ce 00000020:01000004:3.0:1787367378.166856:0:6693:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787367378.166888:0:6693:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787367378.166892:0:6693:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787367378.166899:0:6693:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787367378.166903:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787367378.166916:0:6693:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e8f9231b370) 00000020:00000080:3.0:1787367378.166929:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787367378.169252:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367378.169688:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787367378.169695:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787367378.172800:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367378.172812:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787367378.173482:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787367378.173490:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787367378.176508:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367378.176707:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787367378.176723:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787367378.183783:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787367378.183798:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787367378.208390:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367378.209072:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787367378.209093:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787367378.217819:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787367378.217863:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787367378.226030:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787367378.226048:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787367378.239559:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367378.239937:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787367378.239944:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787367378.241538:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787367378.241551:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787367378.287509:0:6693:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367378.287719:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787367378.287725:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787367378.289550:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787367378.289563:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787367378.290078:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787367378.290101:0:6693:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787367378.290107:0:6693:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787367378.304647:0:6693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787367378.304688:0:6693:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787367378.304693:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787367378.304695:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367378.304696:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367378.304697:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367378.304698:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367378.304700:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367378.304701:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367378.304702:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367378.304704:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367378.304706:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367378.304707:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367378.304710:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787367378.304713:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367378.304718:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367378.304719:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367378.304720:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367378.304721:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367378.304722:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367378.304722:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367378.304724:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367378.304725:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367378.304726:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367378.304727:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787367378.304752:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787367378.304772:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446629888:0@lo:253: 00000100:00100000:3.0:1787367378.304848:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.305078:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.305147:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446629888 00000100:00100000:0.0:1787367378.305153:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446629888 00000100:00100000:0.0:1787367378.305317:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367378.305327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446629888:12345-0@lo:253: 20000000:01000000:0.0:1787367378.305358:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787367378.305361:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787367378.305367:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787367378.305371:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787367378.306277:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367378.306501:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787367378.306514:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787367378.306555:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787367378.306563:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787367378.306594:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787367378.306659:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787367378.307030:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787367378.307050:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:0.0:1787367378.307052:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:0.0:1787367378.307088:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787367378.307095:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787367378.307143:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787367378.307150:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:0.0:1787367378.307182:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787367378.307212:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787367378.307243:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787367378.307292:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787367378.307974:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787367378.307989:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:0.0:1787367378.307991:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:0.0:1787367378.308031:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787367378.308043:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787367378.308068:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787367378.308263:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:1.0:1787367378.308324:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787367378.308335:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787367378.308366:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787367378.308416:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787367378.308433:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787367378.308436:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787367378.308446:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787367378.308448:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787367378.308450:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787367378.308462:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787367378.308465:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787367378.308497:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787367378.308500:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787367378.308971:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787367378.309134:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787367378.309167:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787367378.309308:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787367378.309321:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787367378.309322:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367378.309725:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367378.309770:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367378.309816:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787367378.311107:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787367378.311413:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787367378.311452:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787367378.311468:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787367378.311471:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367378.312051:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367378.312101:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367378.312154:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787367378.312429:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787367378.312459:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787367378.312502:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1787367378.312517:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787367378.312535:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.312552:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.312559:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.312572:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.312580:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.313170:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.313188:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 12 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367378.313383:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630016:0@lo:104: 00000100:00100000:3.0:1787367378.313584:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367378.313798:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.313808:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.313817:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630144:0@lo:104: 00000100:00100000:3.0:1787367378.313838:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367378.314045:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.314053:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.314061:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630272:0@lo:104: 00000100:00100000:3.0:1787367378.314080:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.314168:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630016 00000100:00100000:2.0:1787367378.314174:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630016 00000100:00100000:2.0:1787367378.314274:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630144 00000100:00100000:2.0:1787367378.314277:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630144 00000100:00100000:2.0:1787367378.314292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367378.314299:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:5834:x1874190446630016:12345-0@lo:104: 00010000:00010000:2.0:1787367378.314312:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.314517:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367378.314524:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:5834:x1874190446630016:12345-0@lo:104: Request processed in 225us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367378.314531:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367378.314548:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367378.314554:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:5834:x1874190446630144:12345-0@lo:104: 00010000:00010000:2.0:1787367378.314570:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367378.315102:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630272 00000100:00100000:1.0:1787367378.315107:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630272 00000100:00100000:3.0:1787367378.315292:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a000 going to sleep for 11 seconds 00010000:00010000:0.0:1787367378.315313:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787367378.315316:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630016:0@lo:104: 00010000:00010000:0.0:1787367378.315323:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315333:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496400 already unused, calling callback (ffffffffc1ccec20) 00000100:00100000:3.0:1787367378.315343:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630144:0@lo:104: 10000000:00010000:0.0:1787367378.315349:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315359:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367378.315367:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367378.315373:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367378.315413:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315420:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787367378.315460:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446630400:0@lo:103: 00000100:00100000:1.0:1787367378.315496:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.315567:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630400 00000100:00100000:3.0:1787367378.315572:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630400 00010000:00010000:3.0:1787367378.315590:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 13 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.315625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367378.315633:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+13:3310:x1874190446630400:12345-0@lo:103: 00010000:00010000:3.0:1787367378.315645:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367378.315650:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 13 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.315660:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 13 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.315675:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2175400/0xcbf1f1bac53f3481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f347a expref: 13 pid: 5836 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.315688:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367378.315877:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367378.315881:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446630400:0@lo:103: 00000100:00100000:3.0:1787367378.315882:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+12:3310:x1874190446630400:12345-0@lo:103: Request processed in 249us (384us total) trans 0 rc 0/0 00010000:00010000:0.0:1787367378.315894:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81496400/0xcbf1f1bac53f347a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3481 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.315895:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787367378.315920:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367378.315924:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315939:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80030800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367378.315943:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315950:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367378.315956:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367378.315960:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367378.315980:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.315986:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367378.316000:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.316007:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80030800/0xcbf1f1bac53f340a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3411 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.316016:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367378.316018:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367378.316021:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367378.316029:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367378.316039:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446630528:0@lo:103: 00000100:00100000:1.0:1787367378.316064:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.316132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630528 00000100:00100000:3.0:1787367378.316137:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630528 00010000:00010000:3.0:1787367378.316151:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.316177:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367378.316184:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+12:3310:x1874190446630528:12345-0@lo:103: 00010000:00010000:3.0:1787367378.316368:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367378.316373:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.316382:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.316393:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f340a expref: 12 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.316403:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367378.316463:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+11:3310:x1874190446630528:12345-0@lo:103: Request processed in 281us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.316468:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367378.316502:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446630528:0@lo:103: 00010000:00010000:2.0:1787367378.317021:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787367378.317029:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:5834:x1874190446630144:12345-0@lo:104: Request processed in 2474us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367378.317038:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367378.317056:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367378.317064:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:5834:x1874190446630272:12345-0@lo:104: 00010000:00010000:2.0:1787367378.317074:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317170:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367378.317236:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367378.317243:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:5834:x1874190446630272:12345-0@lo:104: Request processed in 181us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367378.317251:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787367378.317281:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367378.317286:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317292:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367378.317295:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317307:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367378.317312:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367378.317316:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367378.317420:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317424:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367378.317444:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317448:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f33ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f33f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.317458:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.317460:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.317461:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367378.317465:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367378.317472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446630656:0@lo:103: 00000100:00100000:1.0:1787367378.317494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.317635:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1874190446630272:0@lo:104: 00010000:00010000:3.0:1787367378.317658:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.317674:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630656 00000100:00100000:3.0:1787367378.317678:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630656 00010000:00010000:3.0:1787367378.317695:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.317721:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787367378.317728:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+11:3313:x1874190446630656:12345-0@lo:103: 00010000:00010000:3.0:1787367378.317737:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367378.317742:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317834:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317847:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f33f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f33ee expref: 11 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317861:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317870:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317883:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317890:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317898:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317905:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317911:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367378.317915:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317923:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317943:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.317952:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367378.318107:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+10:3313:x1874190446630656:12345-0@lo:103: Request processed in 379us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.318114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787367378.318133:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.318141:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.318148:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f34dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787367378.318162:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787367378.318832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446630656:0@lo:103: 00000100:00100000:1.0:1787367378.369233:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+9:6693:x1874190446629888:12345-0@lo:253: Request processed in 63898us (64376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.369250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367378.369358:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446629888:0@lo:253: 10000000:01000000:3.0:1787367378.369371:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787367378.369373:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367378.369375:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367378.369376:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367378.369377:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787367378.369378:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367378.369379:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367378.369380:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367378.369381:0:6693:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787367378.369382:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367378.369383:0:6693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787367378.369398:0:6693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8fb88be800 from lustre-OST0000 10000000:01000000:3.0:1787367378.369546:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787367378.369559:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787367378.369565:0:6693:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e8f9231cd28 local copy 10000000:01000000:3.0:1787367378.369568:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787367378.369597:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.369619:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.369629:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.369644:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446630784:0@lo:101: 00000100:00100000:3.0:1787367378.369690:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367378.369741:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630784 00000100:00100000:0.0:1787367378.369747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630784 00000100:00100000:3.0:1787367378.369863:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.369865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367378.369875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+9:6693:x1874190446630784:12345-0@lo:101: 00010000:00010000:0.0:1787367378.369887:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367378.369906:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f34ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f34e3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.369935:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f34ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34e3 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.369947:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f34ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34e3 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.369957:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030800, rc 0) 00000100:00100000:0.0:1787367378.370061:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+10:6693:x1874190446630784:12345-0@lo:101: Request processed in 187us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.370067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367378.370076:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446630784:0@lo:101: 00010000:00010000:3.0:1787367378.370100:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.370110:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.370815:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446630912:0@lo:501: 00000100:00100000:3.0:1787367378.370842:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.370869:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.370894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446630912 00000100:00100000:1.0:1787367378.370905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446630912 00000100:00100000:1.0:1787367378.370944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787367378.370952:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:6693:x1874190446630912:12345-0@lo:501: 00000100:00100000:1.0:1787367378.371257:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:6693:x1874190446630912:12345-0@lo:501: Request processed in 305us (412us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367378.371264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787367378.371452:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446630912:0@lo:501: 10000000:01000000:3.0:1787367378.371469:0:6693:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787367378.371500:0:6693:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787367378.371508:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.371524:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.371531:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.371550:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367378.371574:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8fb88be800 10000000:01000000:3.0:1787367378.371579:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787367378.371579:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787367378.371588:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e8f9231cd28 00010000:00010000:1.0:1787367378.371589:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367378.371591:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787367378.371598:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e8f9231cd28 from 1 00010000:00010000:1.0:1787367378.371602:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175400 already unused, calling callback (ffffffffc1ccec20) 10000000:01000000:3.0:1787367378.371603:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:00010000:1.0:1787367378.371621:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371630:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367378.371636:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.371640:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367378.371640:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367378.371651:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371663:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.371664:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371679:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367378.371689:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631040:0@lo:101: 00000100:00100000:3.0:1787367378.371720:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367378.371744:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367378.371750:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787367378.371766:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371775:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f34e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f34ea expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371802:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.371804:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.371806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367378.371827:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446631168:0@lo:103: 00000100:00100000:0.0:1787367378.371854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367378.371883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631040 00000100:00100000:1.0:1787367378.371885:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631168 00000100:00100000:1.0:1787367378.371888:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631168 00000100:00100000:0.0:1787367378.371888:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631040 00000100:00100000:1.0:1787367378.371914:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367378.371914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787367378.371921:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+11:3312:x1874190446631168:12345-0@lo:103: 00000100:00100000:0.0:1787367378.371921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631040:12345-0@lo:101: 00010000:00010000:0.0:1787367378.371930:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367378.371931:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367378.371941:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030a00/0xcbf1f1bac53f34f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f34f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371944:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f34ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f34e3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.371956:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367378.371957:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030a00/0xcbf1f1bac53f34f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34f1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.371966:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030a00/0xcbf1f1bac53f34f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34f1 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367378.372015:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446631168:0@lo:103: 00010000:00010000:0.0:1787367378.372050:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030a00, rc 0) 00000100:00100000:1.0:1787367378.372059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+11:3312:x1874190446631168:12345-0@lo:103: Request processed in 138us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.372066:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367378.372096:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+10:6693:x1874190446631040:12345-0@lo:101: Request processed in 175us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.372102:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787367378.372123:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631040:0@lo:101: 00010000:00010000:3.0:1787367378.372136:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.372164:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367378.372180:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787367378.372217:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.372225:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367378.372232:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787367378.372237:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367378.372242:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787367378.372244:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787367378.372257:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.372264:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.372272:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.372283:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631296:0@lo:101: 00000100:00100000:3.0:1787367378.372307:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.372328:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.372340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631296 00000100:00100000:1.0:1787367378.372345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631296 00000100:00100000:1.0:1787367378.372378:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367378.372384:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+10:6693:x1874190446631296:12345-0@lo:101: 00010000:00010000:1.0:1787367378.372391:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367378.372400:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f34ff expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.372414:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.372422:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.372439:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e200, rc 0) 00000100:00100000:1.0:1787367378.372478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631296:12345-0@lo:101: Request processed in 92us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.372484:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787367378.372546:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631296:0@lo:101: 00010000:00010000:3.0:1787367378.372559:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.372575:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.372776:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631424:0@lo:501: 00000100:00100000:3.0:1787367378.372803:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.372823:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.372853:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631424 00000100:00100000:0.0:1787367378.372858:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631424 00000100:00100000:0.0:1787367378.372892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367378.372921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631424:12345-0@lo:501: 00000100:00100000:0.0:1787367378.373471:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631424:12345-0@lo:501: Request processed in 572us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.373479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787367378.373539:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631424:0@lo:501: 00000100:00100000:3.0:1787367378.373566:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631552:0@lo:503: 00000100:00100000:3.0:1787367378.373622:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.373650:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.373698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631552 00000100:00100000:1.0:1787367378.373703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631552 00000100:00100000:1.0:1787367378.373776:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367378.373784:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631552:12345-0@lo:503: 00000100:00100000:1.0:1787367378.373933:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631552:12345-0@lo:503: Request processed in 150us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.373941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787367378.374076:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631552:0@lo:503: 00000040:00080000:3.0:1787367378.374343:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787367378.374396:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631680:0@lo:502: 00000100:00100000:3.0:1787367378.374434:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.374522:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.374564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631680 00000100:00100000:0.0:1787367378.374569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631680 00000100:00100000:0.0:1787367378.374601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367378.374618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631680:12345-0@lo:502: 00000100:00100000:0.0:1787367378.374789:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631680:12345-0@lo:502: Request processed in 182us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.374796:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787367378.374856:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631680:0@lo:502: 00000040:00080000:3.0:1787367378.375169:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787367378.375223:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787367378.375256:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787367378.375299:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787367378.375321:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787367378.375337:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787367378.375353:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631808:0@lo:502: 00000100:00100000:3.0:1787367378.375383:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.375414:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.375451:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631808 00000100:00100000:1.0:1787367378.375455:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631808 00000100:00100000:1.0:1787367378.375483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787367378.375489:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631808:12345-0@lo:502: 00000100:00100000:1.0:1787367378.375589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631808:12345-0@lo:502: Request processed in 100us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.375594:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787367378.375631:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631808:0@lo:502: 00000040:00080000:3.0:1787367378.375709:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787367378.375719:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787367378.376280:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787367378.376288:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787367378.376295:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367378.376297:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787367378.376302:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787367378.376324:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e8fbf644d28) 00000020:00000080:3.0:1787367378.376343:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787367378.376348:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787367378.376400:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fb88be800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787367378.376407:0:6711:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787367378.376414:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbf1f1bac53f3514 00010000:00010000:3.0:1787367378.380140:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787367378.380503:0:6711:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787367378.382794:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787367378.383050:0:6711:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787367378.388499:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787367378.388924:0:6711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787367378.390634:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787367378.390644:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367378.390649:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367378.390651:0:6711:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787367378.390653:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367378.390657:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367378.390658:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367378.390660:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367378.390661:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787367378.390711:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367378.390713:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367378.390715:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367378.390717:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787367378.390940:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787367378.390964:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787367378.390988:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.391000:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367378.391008:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fb88be800 from 1 10000000:01000000:3.0:1787367378.391011:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367378.391049:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.391067:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.391078:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.391100:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631936:0@lo:101: 00000100:00100000:3.0:1787367378.391174:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.391256:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.391294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446631936 00000100:00100000:0.0:1787367378.391301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446631936 00000100:00100000:0.0:1787367378.391399:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367378.391411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:6693:x1874190446631936:12345-0@lo:101: 00010000:00010000:0.0:1787367378.391425:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367378.391438:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f351b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.391477:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.391489:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.391498:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030400, rc 0) 00000100:00100000:0.0:1787367378.391557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446631936:12345-0@lo:101: Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.391564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787367378.391645:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446631936:0@lo:101: 00010000:00010000:2.0:1787367378.391660:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367378.391669:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367378.391775:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632064:0@lo:501: 00000100:00100000:2.0:1787367378.391810:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.391894:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa25ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.391931:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632064 00000100:00100000:3.0:1787367378.391936:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632064 00000100:00100000:3.0:1787367378.391960:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367378.391967:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632064:12345-0@lo:501: 00000100:00100000:3.0:1787367378.392224:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632064:12345-0@lo:501: Request processed in 256us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.392232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787367378.392388:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632064:0@lo:501: 00000100:00100000:2.0:1787367378.392419:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632192:0@lo:503: 00000100:00100000:2.0:1787367378.392459:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.392489:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa25ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.392538:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632192 00000100:00100000:3.0:1787367378.392543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632192 00000100:00100000:3.0:1787367378.392620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367378.392627:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632192:12345-0@lo:503: 00000100:00100000:3.0:1787367378.392906:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632192:12345-0@lo:503: Request processed in 278us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.392914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787367378.392983:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632192:0@lo:503: 00000040:00080000:2.0:1787367378.393318:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367378.393384:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632320:0@lo:502: 00000100:00100000:2.0:1787367378.393424:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.393626:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa25ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367378.393673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632320 00000100:00100000:0.0:1787367378.393679:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632320 00000100:00100000:0.0:1787367378.393704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367378.393713:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632320:12345-0@lo:502: 00000100:00100000:0.0:1787367378.393888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632320:12345-0@lo:502: Request processed in 176us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.393895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367378.394350:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632320:0@lo:502: 00000040:00080000:3.0:1787367378.394617:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787367378.394673:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787367378.394709:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632448:0@lo:502: 00000100:00100000:3.0:1787367378.394752:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.394853:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367378.394915:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632448 00000100:00100000:2.0:1787367378.394920:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632448 00000100:00100000:2.0:1787367378.394996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367378.395004:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632448:12345-0@lo:502: 00000100:00100000:2.0:1787367378.395169:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632448:12345-0@lo:502: Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367378.395176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787367378.395326:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632448:0@lo:502: 00000040:00080000:3.0:1787367378.395426:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787367378.395436:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787367378.395787:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367378.395796:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367378.395798:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787367378.395804:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fb88be800 00000020:00000080:3.0:1787367378.395807:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367378.395825:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367378.395828:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367378.395830:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787367378.395832:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787367378.395861:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787367378.395876:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367378.395890:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.395901:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367378.395937:0:6693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787367378.395940:0:6693:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8fb88be800 10000000:01000000:3.0:1787367378.395943:0:6693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8fb88be800 10000000:01000000:3.0:1787367378.395947:0:6693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367378.395952:0:6693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fb88be800 from 1 10000000:01000000:3.0:1787367378.395955:0:6693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367378.395979:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.395991:0:6693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.396000:0:6693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.396013:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632576:0@lo:101: 00000100:00100000:3.0:1787367378.396050:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.396077:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.396093:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632576 00000100:00100000:3.0:1787367378.396097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632576 00000100:00100000:3.0:1787367378.396119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787367378.396127:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446632576:12345-0@lo:101: 00010000:00010000:3.0:1787367378.396137:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367378.396149:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3529 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.396170:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.396181:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.396189:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2174e00, rc 0) 00000100:00100000:3.0:1787367378.396242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632576:12345-0@lo:101: Request processed in 117us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.396249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787367378.396288:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632576:0@lo:101: 00010000:00010000:3.0:1787367378.396308:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.396317:0:6693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.396381:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632704:0@lo:501: 00000100:00100000:3.0:1787367378.396409:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.396424:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.396441:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632704 00000100:00100000:3.0:1787367378.396444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632704 00000100:00100000:3.0:1787367378.396461:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367378.396466:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632704:12345-0@lo:501: 00000100:00100000:3.0:1787367378.396667:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632704:12345-0@lo:501: Request processed in 200us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.396675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367378.396776:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632704:0@lo:501: 00000100:00100000:2.0:1787367378.396800:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632832:0@lo:503: 00000100:00100000:2.0:1787367378.396835:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.396896:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa25cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.396928:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632832 00000100:00100000:3.0:1787367378.396931:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632832 00000100:00100000:3.0:1787367378.396962:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367378.396968:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632832:12345-0@lo:503: 00000100:00100000:3.0:1787367378.397093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632832:12345-0@lo:503: Request processed in 120us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.397100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367378.397115:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632832:0@lo:503: 00000040:00080000:2.0:1787367378.397392:0:6693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367378.397426:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632960:0@lo:502: 00000100:00100000:2.0:1787367378.397450:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.397471:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.397482:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446632960 00000100:00100000:3.0:1787367378.397486:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446632960 00000100:00100000:3.0:1787367378.397514:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367378.397520:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632960:12345-0@lo:502: 00000100:00100000:3.0:1787367378.397676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446632960:12345-0@lo:502: Request processed in 155us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.397683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367378.397841:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446632960:0@lo:502: 00000040:00080000:2.0:1787367378.398053:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787367378.398101:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787367378.398149:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787367378.398336:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787367378.398379:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787367378.398441:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787367378.398479:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787367378.398513:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787367378.398571:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787367378.398630:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787367378.398667:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787367378.398733:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787367378.398772:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787367378.398809:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787367378.398868:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787367378.398905:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787367378.398939:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787367378.398989:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787367378.399042:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787367378.399078:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787367378.399124:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787367378.399159:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787367378.399311:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787367378.399366:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787367378.399405:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787367378.399438:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787367378.399485:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787367378.399522:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787367378.399562:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446633088:0@lo:502: 00000100:00100000:2.0:1787367378.399648:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367378.399750:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.399800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633088 00000100:00100000:1.0:1787367378.399807:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633088 00000100:00100000:1.0:1787367378.399888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787367378.399897:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446633088:12345-0@lo:502: 00000100:00100000:1.0:1787367378.400136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446633088:12345-0@lo:502: Request processed in 240us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.400144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367378.400453:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446633088:0@lo:502: 00000040:00080000:3.0:1787367378.400533:0:6693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787367378.400545:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787367378.401023:0:6716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787367378.401042:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e8fafce99b8) 00000020:00000080:1.0:1787367378.401062:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787367378.401134:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fb88be800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787367378.401138:0:6716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8fb88be800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787367378.401140:0:6716:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fb88be800 3 00010000:00080000:1.0:1787367378.401177:0:6716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fafac1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.123@tcp at head 00010000:00010000:1.0:1787367378.403476:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787367378.403678:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787367378.403710:0:6716:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787367378.403720:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbf1f1bac53f353e 00000100:00080000:1.0:1787367378.403730:0:6716:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787367378.403736:0:6716:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e8fafac1800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367378.403781:0:6716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fb2a58a80 x1874190446633216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367378.403808:0:6716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787367378.403839:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446633216:0@lo:38: 00000100:00100000:3.0:1787367378.403904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367378.403949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633216 00000100:00100000:1.0:1787367378.403956:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633216 00000100:00100000:1.0:1787367378.404001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367378.404009:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874190446633216:12345-0@lo:38: 00010000:00080000:1.0:1787367378.404031:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000100:00100000:2.0:1787367378.404043:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446633344:0@lo:400: 00000100:00100000:2.0:1787367378.404072:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.404162:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787367378.404171:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787367378.404181:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787367378.404189:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633344 00000100:00100000:3.0:1787367378.404229:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633344 00000100:00100000:3.0:1787367378.404256:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787367378.404265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367378.404272:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446633344:12345-0@lo:400: 00000100:00100000:3.0:1787367378.404322:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446633344:12345-0@lo:400: Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.404329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787367378.404412:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8f83f5ed80 x1874190446633344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367378.404426:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446633344:0@lo:400: 00000020:00000080:1.0:1787367378.404693:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbf1f1bac53f3545 00000004:00100000:1.0:1787367378.404708:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787367378.404735:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e8fbfa04800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367378.404781:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874190446633216:12345-0@lo:38: Request processed in 771us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.404788:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787367378.405256:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8fb2a58a80 x1874190446633216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367378.405265:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367378.405272:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787367378.405280:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787367378.405284:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787367378.405286:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787367378.405291:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446633216:0@lo:38: 00000040:00080000:1.0:1787367378.405779:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787367378.405901:0:6693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787367378.405927:0:6693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367378.405952:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.405964:0:6693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787367378.406010:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787367378.406012:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367378.406014:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367378.406015:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367378.406017:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367378.406018:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367378.406019:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367378.406021:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367378.406022:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367378.406024:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367378.406025:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367378.406029:0:6693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787367378.406032:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367378.406033:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787367378.406034:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367378.406035:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367378.406036:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367378.406037:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367378.406038:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367378.406039:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367378.406040:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367378.406042:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367378.406043:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367378.406061:0:6693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787367378.406074:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446633472:0@lo:253: 00000100:00100000:3.0:1787367378.406133:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.406167:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f8312df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367378.406187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633472 00000100:00100000:3.0:1787367378.406225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633472 00000100:00100000:3.0:1787367378.406260:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367378.406267:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6693:x1874190446633472:12345-0@lo:253: 20000000:01000000:3.0:1787367378.406292:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787367378.406305:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787367378.434896:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787367378.434935:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787367378.434979:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787367378.434985:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787367378.435007:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.435027:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.435036:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.435075:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.435090:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 13 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.435104:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446633600:0@lo:104: 00000100:00100000:3.0:1787367378.435184:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367378.435275:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f854c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367378.435438:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633600 00000100:00100000:1.0:1787367378.435445:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633600 00000100:00100000:1.0:1787367378.435487:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367378.435494:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446633600:12345-0@lo:104: 00010000:00010000:1.0:1787367378.435507:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.435585:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367378.435591:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446633600:12345-0@lo:104: Request processed in 98us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367378.435599:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787367378.435634:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367378.435641:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.435649:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80031200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367378.435652:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.435661:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367378.435667:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367378.435672:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367378.435699:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.435705:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367378.435729:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.435736:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80031200/0xcbf1f1bac53f34a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367378.435837:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446633728:0@lo:103: 00000100:00100000:2.0:1787367378.435871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367378.435894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633728 00000100:00100000:0.0:1787367378.435899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633728 00010000:00010000:0.0:1787367378.435917:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367378.435945:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367378.435952:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+14:3311:x1874190446633728:12345-0@lo:103: 00010000:00010000:0.0:1787367378.435963:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367378.435967:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.435987:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367378.435992:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446633600:0@lo:104: 00010000:00010000:0.0:1787367378.436000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5fc00/0xcbf1f1bac53f34ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f34a4 expref: 14 pid: 5835 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367378.436009:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.436013:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.436020:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.436111:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.436113:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367378.436115:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787367378.440151:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005165467s 00010000:00010000:0.0:1787367378.440167:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440179:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440186:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440223:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440230:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367378.440234:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440243:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440281:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367378.440295:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367378.440317:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.440330:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367378.440337:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f354c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367378.440383:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+13:3311:x1874190446633728:12345-0@lo:103: Request processed in 4427us (4507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367378.440394:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367378.440421:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446633728:0@lo:103: 00000100:00100000:3.0:1787367378.442895:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:6693:x1874190446633472:12345-0@lo:253: Request processed in 36619us (36752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367378.442922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787367378.442940:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:6693:1874190446633472:0@lo:253: 10000000:01000000:0.0:1787367378.442958:0:6693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787367378.442962:0:6693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787367378.442964:0:6693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787367378.442966:0:6693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367378.442967:0:6693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367378.442969:0:6693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367378.442970:0:6693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367378.442971:0:6693:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787367378.442973:0:6693:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787367378.442974:0:6693:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787367378.442976:0:6693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367378.442977:0:6693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787367378.442992:0:6693:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787367378.447168:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367378.447369:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367378.447558:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367378.447885:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367378.448090:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367378.448572:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787367378.451954:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787367378.567645:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787367378.660949:0:6693:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787367378.660957:0:6693:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787367378.660986:0:6693:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787367378.661041:0:6693:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787367378.661055:0:6693:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787367378.661086:0:6693:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787367379.588302:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367380.622307:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367381.639024:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367382.661042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787367383.619300:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787367383.619308:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f92200800 from 21 10000000:01000000:2.0:1787367383.619320:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367383.619362:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.619413:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.619425:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367383.619452:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446633856:0@lo:101: 00000100:00100000:2.0:1787367383.619578:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.619626:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f916e16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367383.619648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633856 00000100:00100000:1.0:1787367383.619656:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633856 00000100:00100000:1.0:1787367383.619701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367383.619709:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446633856:12345-0@lo:101: 00010000:00010000:1.0:1787367383.619723:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367383.619736:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3553 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367383.619761:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367383.619772:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367383.619787:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f000, rc 0) 00000100:00100000:1.0:1787367383.619827:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446633856:12345-0@lo:101: Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.619833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787367383.620130:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446633856:0@lo:101: 00010000:00010000:2.0:1787367383.620145:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.620154:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367383.620223:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634368:0@lo:501: 00000100:00100000:2.0:1787367383.620251:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.620265:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f8312da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367383.620367:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446633984:0@lo:400: 00000100:00100000:3.0:1787367383.620396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.620420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367383.620459:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634368 00000100:00100000:2.0:1787367383.620464:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634368 00000100:00100000:2.0:1787367383.620489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446633984 00000100:00100000:2.0:1787367383.620492:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446633984 00000100:00100000:2.0:1787367383.620518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787367383.620524:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446634368:12345-0@lo:501: 00000100:00100000:3.0:1787367383.620651:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446634112:0@lo:400: 00000100:00100000:3.0:1787367383.620685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.620725:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446634240:0@lo:400: 00000100:00100000:3.0:1787367383.620749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.620782:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787367383.620791:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:3312:x1874190446633984:12345-0@lo:400: 00000100:00100000:3.0:1787367383.620824:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:3312:x1874190446633984:12345-0@lo:400: Request processed in 36us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.620830:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787367383.620856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634112 00000100:00100000:3.0:1787367383.620859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634112 00000100:00100000:3.0:1787367383.620880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634240 00000100:00100000:3.0:1787367383.620882:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634240 00000100:00080000:0.0:1787367383.620909:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367383.620913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367383.620919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446634112:12345-0@lo:400: 00000100:00100000:3.0:1787367383.620955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446634112:12345-0@lo:400: Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.621221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367383.621229:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446634240:12345-0@lo:400: 00000100:00100000:1.0:1787367383.621267:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446634240:12345-0@lo:400: Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.621273:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367383.621295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446634368:12345-0@lo:501: Request processed in 771us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.621301:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787367383.621306:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080ed80 x1874190446634240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367383.621319:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446634240:0@lo:400: 00000100:00100000:2.0:1787367383.621330:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634368:0@lo:501: 00000100:00100000:2.0:1787367383.621360:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634496:0@lo:503: 00000100:00100000:2.0:1787367383.621395:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.621424:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f8312da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367383.621539:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634496 00000100:00100000:1.0:1787367383.621543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634496 00000100:00100000:1.0:1787367383.621637:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787367383.621723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367383.621728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446634496:12345-0@lo:503: 00010000:00080000:3.0:1787367383.621757:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080ca80 x1874190446634112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367383.621766:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446634112:0@lo:400: 00000100:00100000:3.0:1787367383.621774:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446633984:0@lo:400: 00000100:00100000:1.0:1787367383.622018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446634496:12345-0@lo:503: Request processed in 323us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.622025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787367383.622379:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634496:0@lo:503: 00000100:00100000:2.0:1787367383.622839:0:6993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6993:1874190446634624:0@lo:502: 00000100:00100000:2.0:1787367383.622957:0:6993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.623052:0:6993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f8312d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367383.623109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634624 00000100:00100000:3.0:1787367383.623114:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634624 00000100:00100000:3.0:1787367383.623151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367383.623158:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:6993:x1874190446634624:12345-0@lo:502: 00000100:00100000:3.0:1787367383.623415:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:6993:x1874190446634624:12345-0@lo:502: Request processed in 257us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.623422:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367383.623433:0:6993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6993:1874190446634624:0@lo:502: 00000100:00100000:1.0:1787367383.623475:0:6993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6993:1874190446634752:0@lo:502: 00000100:00100000:1.0:1787367383.623528:0:6993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367383.623555:0:6993:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f8312d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367383.626735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634752 00000100:00100000:3.0:1787367383.626747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634752 00000100:00100000:3.0:1787367383.626861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787367383.626872:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6993:x1874190446634752:12345-0@lo:502: 00000100:00100000:3.0:1787367383.627153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:6993:x1874190446634752:12345-0@lo:502: Request processed in 283us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.627161:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787367383.627253:0:6993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6993:1874190446634752:0@lo:502: 00000040:00080000:0.0:1787367383.627298:0:6993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787367383.630953:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787367383.631053:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367383.631064:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.631086:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367383.631097:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787367383.631099:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8f92200800 from 4 10000000:01000000:3.0:1787367383.631103:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787367383.631138:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.631145:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.631155:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367383.631178:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634880:0@lo:101: 00000100:00100000:3.0:1787367383.631792:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.631830:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367383.632027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446634880 00000100:00100000:3.0:1787367383.632033:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446634880 00000100:00100000:3.0:1787367383.632110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787367383.632119:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446634880:12345-0@lo:101: 00010000:00010000:3.0:1787367383.632133:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367383.632148:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3561 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.632170:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.632207:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.632216:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2175600, rc 0) 00000100:00100000:3.0:1787367383.632254:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446634880:12345-0@lo:101: Request processed in 136us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.632260:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787367383.639338:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446634880:0@lo:101: 00010000:00010000:3.0:1787367383.639367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.639380:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367383.639455:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635008:0@lo:256: 00000100:00100000:3.0:1787367383.639533:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.639582:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367383.639645:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635008 00000100:00100000:1.0:1787367383.639658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635008 00000100:00100000:1.0:1787367383.639708:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787367383.639717:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446635008:12345-0@lo:256: 20000000:01000000:1.0:1787367383.639739:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787367383.639753:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787367383.639756:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787367383.639837:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446635008:12345-0@lo:256: Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.639845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367383.640813:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635008:0@lo:256: 10000000:01000000:3.0:1787367383.640926:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367383.640935:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.640944:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367383.640952:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787367383.641269:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787367383.641272:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787367383.641317:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.641324:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.641332:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367383.641348:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635136:0@lo:101: 00000100:00100000:3.0:1787367383.641392:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.641466:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.643032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635136 00000100:00100000:2.0:1787367383.643042:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635136 00000100:00100000:2.0:1787367383.644387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787367383.644404:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446635136:12345-0@lo:101: 00010000:00010000:2.0:1787367383.644421:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367383.644440:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f356f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.644474:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.644486:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.644494:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496400, rc 0) 00000100:00100000:2.0:1787367383.644587:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635136:12345-0@lo:101: Request processed in 189us (3193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.644605:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787367383.647382:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635136:0@lo:101: 00010000:00010000:3.0:1787367383.647411:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367383.647424:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367383.647515:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635264:0@lo:501: 00000100:00100000:3.0:1787367383.648745:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.648796:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.649076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635264 00000100:00100000:2.0:1787367383.649084:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635264 00000100:00100000:2.0:1787367383.649951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367383.650031:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635264:12345-0@lo:501: 00000100:00100000:2.0:1787367383.652096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635264:12345-0@lo:501: Request processed in 2127us (3347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.652110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367383.652348:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635264:0@lo:501: 00000100:00100000:2.0:1787367383.652411:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635392:0@lo:503: 00000100:00100000:2.0:1787367383.652462:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.652498:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92259000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.652528:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635392 00000100:00100000:2.0:1787367383.652535:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635392 00000100:00100000:2.0:1787367383.653339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787367383.653350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635392:12345-0@lo:503: 00000100:00100000:2.0:1787367383.655523:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635392:12345-0@lo:503: Request processed in 2156us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.655536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787367383.655554:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635392:0@lo:503: 00000100:00100000:1.0:1787367383.655757:0:6996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6996:1874190446635520:0@lo:502: 00000100:00100000:1.0:1787367383.655802:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367383.658644:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635520 00000100:00100000:1.0:1787367383.658658:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635520 00000100:00100000:1.0:1787367383.658709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787367383.658719:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:6996:x1874190446635520:12345-0@lo:502: 00000100:00100000:1.0:1787367383.659039:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:6996:x1874190446635520:12345-0@lo:502: Request processed in 322us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.659048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787367383.659102:0:6996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367383.659123:0:6996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6996:1874190446635520:0@lo:502: 00000020:01000000:1.0:1787367383.659154:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787367383.659162:0:6996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787367383.659168:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367383.659171:0:6996:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787367383.659176:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787367383.659180:0:6996:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:1.0:1787367383.659228:0:6996:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787367383.659232:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787367383.659245:0:6996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e8fafcecd28) 00000020:00000080:1.0:1787367383.659269:0:6996:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787367383.659274:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787367383.659349:0:6996:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787367383.659355:0:6996:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787367383.659362:0:6996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f3584 00010000:00080000:1.0:1787367383.659388:0:6996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fbf5fb800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:1.0:1787367383.659617:0:6996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1787367383.691841:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787367383.747407:0:6996:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787367383.747430:0:6996:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787367383.749304:0:6996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367383.749491:0:6996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367383.750711:0:6996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787367383.750816:0:6996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787367383.756623:0:7002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367383.756632:0:7002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787367383.762532:0:6996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367383.762548:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787367383.762583:0:6996:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787367383.762602:0:6996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f358b 00000100:00080000:1.0:1787367383.762613:0:6996:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787367383.762619:0:6996:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e8fbf5fb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367383.762655:0:6996:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fb2a59880 x1874190446635648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367383.762682:0:6996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787367383.762732:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367383.762736:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367383.762737:0:6996:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787367383.762747:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367383.762751:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367383.762753:0:6996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367383.762755:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367383.762757:0:6996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787367383.762784:0:6996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6996:1874190446635776:0@lo:502: 00000100:00100000:1.0:1787367383.762866:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367383.762918:0:6996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.763019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635776 00000100:00100000:2.0:1787367383.763026:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635776 00000100:00100000:2.0:1787367383.763070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787367383.763080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:6996:x1874190446635776:12345-0@lo:502: 00000100:00100000:2.0:1787367383.763344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:6996:x1874190446635776:12345-0@lo:502: Request processed in 265us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.763359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367383.763694:0:6996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:6996:1874190446635776:0@lo:502: 00000020:01000000:1.0:1787367383.763721:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367383.763726:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367383.763727:0:6996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787367383.763730:0:6996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1787367383.765330:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446635648:0@lo:8: 00000100:00100000:3.0:1787367383.765393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787367383.765488:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787367383.765524:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787367383.765535:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765548:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367383.765558:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787367383.765561:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e8f9231cd28 from 1 10000000:01000000:2.0:1787367383.765563:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787367383.765593:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765600:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765610:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367383.765625:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635904:0@lo:101: 00000100:00100000:2.0:1787367383.765671:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.765708:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92259780 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.765729:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635904 00000100:00100000:2.0:1787367383.765734:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635904 00000100:00100000:2.0:1787367383.765771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787367383.765779:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446635904:12345-0@lo:101: 00010000:00010000:2.0:1787367383.765790:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367383.765812:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3592 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765833:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765856:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.765865:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497e00, rc 0) 00000100:00100000:2.0:1787367383.765900:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446635904:12345-0@lo:101: Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.765907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787367383.765946:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446635904:0@lo:101: 00000100:00100000:3.0:1787367383.766247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446636032:0@lo:400: 00000100:00100000:3.0:1787367383.766275:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.766312:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446636160:0@lo:400: 00000100:00100000:3.0:1787367383.766333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.766360:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636032 00000100:00100000:3.0:1787367383.766363:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636032 00000100:00100000:3.0:1787367383.766385:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636160 00000100:00100000:3.0:1787367383.766387:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636160 00000100:00100000:3.0:1787367383.766402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367383.766407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446636032:12345-0@lo:400: 00000100:00100000:3.0:1787367383.766439:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446636032:12345-0@lo:400: Request processed in 31us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.766445:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367383.766455:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367383.766460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446636160:12345-0@lo:400: 00000100:00100000:3.0:1787367383.766482:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446636160:12345-0@lo:400: Request processed in 22us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.766487:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787367383.766530:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080c700 x1874190446636032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367383.766542:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446636032:0@lo:400: 00010000:00080000:3.0:1787367383.766559:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080f800 x1874190446636160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367383.766568:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446636160:0@lo:400: 00010000:00010000:2.0:1787367383.766727:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367383.766734:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446635648 00000100:00100000:1.0:1787367383.766738:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446635648 00010000:00010000:2.0:1787367383.766739:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367383.766783:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446636288:0@lo:501: 00000100:00100000:2.0:1787367383.766810:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367383.766813:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367383.766819:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874190446635648:12345-0@lo:8: 00000100:00100000:2.0:1787367383.766829:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92259780 going to sleep for 11 seconds 00010000:00080000:1.0:1787367383.766840:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000100:00100000:2.0:1787367383.766854:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636288 00000100:00100000:2.0:1787367383.766857:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636288 00000020:00000080:1.0:1787367383.766867:0:6695:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f35a0 00000100:00100000:2.0:1787367383.766877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367383.766882:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446636288:12345-0@lo:501: 00002000:00100000:1.0:1787367383.766920:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e8fbfa04000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787367383.766925:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787367383.766928:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787367383.767033:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787367383.767243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446636288:12345-0@lo:501: Request processed in 360us (432us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787367383.767259:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787367383.767308:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446636288:0@lo:501: 10000000:01000000:2.0:1787367383.767327:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787367383.767333:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367383.767340:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787367383.767471:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787367383.767495:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fbfa03000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367383.767555:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874190446635648:12345-0@lo:8: Request processed in 735us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367383.767563:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787367383.767622:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a59880 x1874190446635648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367383.767630:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367383.767636:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787367383.767654:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787367383.767660:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787367383.767662:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf5fb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787367383.767675:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787367383.767680:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446635648:0@lo:8: 00000004:00080000:1.0:1787367383.771294:0:7002:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787367383.771436:0:7002:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189047243072ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787367383.829522:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787367383.829600:0:7003:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787367383.829627:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636544:0@lo:7: 00000100:00100000:1.0:1787367383.829729:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367383.829778:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa01606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367383.829793:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446636416:0@lo:13: 00000100:00100000:1.0:1787367383.829818:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367383.829953:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636416 00000100:00100000:2.0:1787367383.829971:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636416 00000100:00100000:2.0:1787367383.830025:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367383.830034:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446636416:12345-0@lo:13: 00002000:00000024:2.0:1787367383.830064:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787367383.830105:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446636416:12345-0@lo:13: Request processed in 73us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.830112:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787367383.830183:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a5bb80 x1874190446636416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367383.830276:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446636416:0@lo:13: 00000100:00100000:3.0:1787367383.830978:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636544 00000100:00100000:3.0:1787367383.830985:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636544 00000100:00100000:3.0:1787367383.831029:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367383.831038:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7003:x1874190446636544:12345-0@lo:7: 00000100:00080000:1.0:1787367383.831359:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787367383.844886:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787367383.844895:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787367383.845345:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7003:x1874190446636544:12345-0@lo:7: Request processed in 14304us (15611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367383.845358:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787367383.845423:0:7003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a59f80 x1874190446636544/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367399 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367383.845439:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636544:0@lo:7: 00000004:00080000:3.0:1787367383.845455:0:7003:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787367383.845495:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636672:0@lo:5: 00000100:00100000:3.0:1787367383.845538:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.845587:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367383.845894:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636672 00000100:00100000:2.0:1787367383.845901:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636672 00000100:00100000:2.0:1787367383.845950:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367383.845967:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7003:x1874190446636672:12345-0@lo:5: 00002000:00080000:2.0:1787367383.845991:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787367383.845994:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787367383.846287:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7003:x1874190446636672:12345-0@lo:5: Request processed in 320us (747us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787367383.846294:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787367383.847959:0:7003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080f800 x1874190446636672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367399 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367383.847978:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636672:0@lo:5: 00000004:00080000:3.0:1787367383.847991:0:7003:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787367383.848033:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636800:0@lo:700: 00000100:00100000:3.0:1787367383.848079:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367383.848120:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367383.848705:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636800 00000100:00100000:0.0:1787367383.848712:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636800 00000100:00100000:0.0:1787367383.848760:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367383.848768:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7003:x1874190446636800:12345-0@lo:700: 00000100:00100000:0.0:1787367383.848800:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1874190446636928:0@lo:700: 00000100:00100000:0.0:1787367383.848835:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367383.848858:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85364a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367383.848921:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446636928 00000100:00100000:3.0:1787367383.848925:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446636928 00000100:00100000:3.0:1787367383.848959:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367383.848967:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1874190446636928:12345-0@lo:700: 40000000:02000000:2.0:1787367383.893927:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787367383.900141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6704:x1874190446636928:12345-0@lo:700: Request processed in 51164us (51294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367383.900161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787367383.900463:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb3c83100 x1874190446636928/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787367399 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367383.900480:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6704:1874190446636928:0@lo:700: 40000000:02000000:2.0:1787367383.900492:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1787367384.002549:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787367384.002574:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787367384.002788:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7003:x1874190446636800:12345-0@lo:700: Request processed in 154013us (154700us total) trans 0 rc 0/0 00010000:00080000:0.0:1787367384.002810:0:7003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080d500 x1874190446636800/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367399 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367384.002826:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446636800:0@lo:700: 00000100:00100000:3.0:1787367384.002829:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:02000040:1.0:1787367384.067744:0:7003:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787367384.077725:0:7003:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446637056:0@lo:5: 00000100:00100000:1.0:1787367384.077797:0:7003:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367384.077856:0:7003:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367384.078165:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637056 00000100:00100000:3.0:1787367384.078173:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637056 00000100:00100000:3.0:1787367384.078247:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367384.078257:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7003:x1874190446637056:12345-0@lo:5: 00002000:00080000:3.0:1787367384.088676:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787367384.088697:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787367384.099896:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7003:x1874190446637056:12345-0@lo:5: Request processed in 21633us (22090us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367384.099910:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787367384.100309:0:7003:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a5bb80 x1874190446637056/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367400 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367384.100324:0:7003:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787367384.100339:0:7003:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e8fb2a5bb80 x1874190446637056/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367400 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367384.100349:0:7003:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7003:1874190446637056:0@lo:5: 00000004:00080000:0.0:1787367384.100364:0:7003:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787367384.707507:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367385.115571:0:7067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787367385.734985:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367386.755560:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367387.779756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367388.803374:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367389.251426:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446637184:0@lo:400: 00000100:00100000:3.0:1787367389.251507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367389.251701:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367389.251709:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446637312:0@lo:400: 00000100:00100000:3.0:1787367389.251743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367389.252024:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446637440:0@lo:400: 00000100:00100000:3.0:1787367389.252052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367389.252072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367389.252078:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446637568:0@lo:400: 00000100:00100000:3.0:1787367389.252105:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367389.252159:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637184 00000100:00100000:3.0:1787367389.252166:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637184 00000100:00100000:3.0:1787367389.252241:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787367389.252251:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:3310:x1874190446637184:12345-0@lo:400: 00000100:00100000:3.0:1787367389.252458:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:3310:x1874190446637184:12345-0@lo:400: Request processed in 209us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367389.252475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787367389.252499:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367389.252509:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446637696:0@lo:13: 00000100:00100000:0.0:1787367389.252535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367389.252560:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637696 00000100:00100000:3.0:1787367389.252566:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637312 00000100:00100000:3.0:1787367389.252571:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637312 00000100:00100000:0.0:1787367389.252577:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637696 00000100:00100000:3.0:1787367389.252605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637440 00000100:00100000:3.0:1787367389.252609:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637440 00000100:00100000:0.0:1787367389.252615:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367389.252621:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446637696:12345-0@lo:13: 00000100:00100000:3.0:1787367389.252642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00002000:00000024:0.0:1787367389.252645:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367389.252653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446637312:12345-0@lo:400: 00000100:00100000:0.0:1787367389.252705:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446637696:12345-0@lo:13: Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367389.252708:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446637312:12345-0@lo:400: Request processed in 57us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367389.252719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787367389.252724:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367389.252736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367389.252744:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446637440:12345-0@lo:400: 00000100:00080000:0.0:1787367389.252747:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367389.252753:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787367389.252781:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb3c80380 x1874190446637696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367389.252798:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446637696:0@lo:13: 00000100:00100000:3.0:1787367389.253230:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446637440:12345-0@lo:400: Request processed in 486us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367389.253238:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367389.253342:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637568 00000100:00100000:3.0:1787367389.253347:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637568 00000100:00100000:3.0:1787367389.253376:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367389.253383:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446637568:12345-0@lo:400: 00000100:00100000:3.0:1787367389.253429:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446637568:12345-0@lo:400: Request processed in 47us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367389.253435:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787367389.254445:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fbb1ca300 x1874190446637568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367389.254460:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446637568:0@lo:400: 00010000:00080000:0.0:1787367389.254473:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080d500 x1874190446637440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367389.254481:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446637440:0@lo:400: 00010000:00080000:1.0:1787367389.258364:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8f9080f800 x1874190446637312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367389.258385:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446637312:0@lo:400: 00000100:00100000:1.0:1787367389.258414:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446637184:0@lo:400: 00000001:00080000:1.0:1787367389.333899:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787367389.827752:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367390.857210:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367391.875620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367392.899432:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367393.923823:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367394.374546:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446637824:0@lo:13: 00000100:00100000:0.0:1787367394.374620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367394.374682:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446638336:0@lo:400: 00000100:00100000:0.0:1787367394.374707:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367394.374728:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446637952:0@lo:400: 00000100:00100000:0.0:1787367394.374730:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367394.374739:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446638208:0@lo:400: 00000100:00100000:3.0:1787367394.374779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367394.374779:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367394.374818:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637824 00000100:00100000:3.0:1787367394.374823:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367394.374842:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446638080:0@lo:400: 00000100:00100000:3.0:1787367394.374866:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367394.374897:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638208 00000100:00100000:3.0:1787367394.374901:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638208 00000100:00100000:3.0:1787367394.374944:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638080 00000100:00100000:3.0:1787367394.374947:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638080 00000100:00100000:3.0:1787367394.374968:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367394.374977:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446638208:12345-0@lo:400: 00000100:00100000:3.0:1787367394.375027:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446638208:12345-0@lo:400: Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367394.375034:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367394.375049:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367394.375055:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446638080:12345-0@lo:400: 00000100:00100000:3.0:1787367394.375082:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446638080:12345-0@lo:400: Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367394.375088:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787367394.375122:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fbb1c8000 x1874190446638080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367394.375123:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637824 00000100:00100000:3.0:1787367394.375139:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446638080:0@lo:400: 00000100:00100000:0.0:1787367394.375166:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367394.375174:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446637824:12345-0@lo:13: 00002000:00000024:0.0:1787367394.375218:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367394.375256:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446637824:12345-0@lo:13: Request processed in 83us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367394.375262:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367394.375285:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638336 00000100:00100000:0.0:1787367394.375289:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638336 00000100:00100000:0.0:1787367394.375324:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367394.375330:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446638336:12345-0@lo:400: 00000100:00100000:0.0:1787367394.375358:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446638336:12345-0@lo:400: Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367394.375363:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787367394.375381:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367394.375385:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787367394.375411:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fbb1c8380 x1874190446638208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367394.375423:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446638208:0@lo:400: 00010000:00080000:0.0:1787367394.375432:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fbb1c8a80 x1874190446638336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367394.375440:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787367394.375451:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446638336:0@lo:400: 00010000:00080000:0.0:1787367394.375459:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb3c80380 x1874190446637824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367394.375471:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446637824:0@lo:13: 00000100:00100000:1.0:1787367394.378265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446637952 00000100:00100000:1.0:1787367394.378281:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446637952 00000100:00100000:1.0:1787367394.378340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787367394.378350:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3312:x1874190446637952:12345-0@lo:400: 00000100:00100000:1.0:1787367394.378434:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3312:x1874190446637952:12345-0@lo:400: Request processed in 86us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367394.378441:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787367394.383578:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446637952:0@lo:400: 00010000:00010000:1.0:1787367394.952373:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787367395.652066:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787367395.652070:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787367395.652805:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e8fbf411800 00000020:01000004:2.0:1787367395.652822:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787367395.652840:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787367395.652854:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e8fb353cd28) 00000020:00000080:2.0:1787367395.652876:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787367395.673985:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787367395.674591:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787367395.703034:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787367395.709744:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787367395.709783:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787367395.709844:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787367395.709870:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787367395.710185:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787367395.710233:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787367395.710245:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbf1f1bac53f35ae 00000020:01000004:1.0:1787367395.710253:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787367395.710283:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787367395.710287:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787367395.710292:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787367395.710489:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787367395.710494:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787367395.730962:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787367395.731000:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.123@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787367395.731004:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787367395.731006:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787367395.731007:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367395.731012:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367395.731013:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367395.731014:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367395.731015:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367395.731017:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367395.731018:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367395.731019:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367395.731020:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367395.731024:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787367395.731026:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367395.731027:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787367395.731028:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367395.731029:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367395.731030:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367395.731031:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367395.731031:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367395.731032:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787367395.731033:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787367395.731034:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367395.731035:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787367395.731061:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787367395.731080:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446638464:0@lo:253: 00000100:00100000:1.0:1787367395.731162:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367395.731329:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367395.731413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638464 00000100:00100000:3.0:1787367395.731421:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638464 00000100:00100000:3.0:1787367395.731503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367395.731513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:7626:x1874190446638464:12345-0@lo:253: 20000000:01000000:3.0:1787367395.731545:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787367395.731554:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787367395.731560:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787367395.731563:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787367395.732829:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367395.733044:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787367395.733061:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787367395.733099:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787367395.733107:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787367395.733136:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787367395.733184:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787367395.733582:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787367395.733601:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:3.0:1787367395.733603:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:3.0:1787367395.733630:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787367395.733637:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787367395.733678:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787367395.733686:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:3.0:1787367395.733718:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787367395.733727:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787367395.733753:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787367395.733793:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787367395.734630:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787367395.734647:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:3.0:1787367395.734649:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:3.0:1787367395.734681:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787367395.734689:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787367395.734719:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787367395.734726:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:3.0:1787367395.734752:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787367395.734758:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787367395.734794:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787367395.734823:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787367395.734847:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787367395.734850:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787367395.734856:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787367395.734857:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787367395.734860:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787367395.734870:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787367395.734873:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787367395.734906:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787367395.734908:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367395.735677:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367395.735753:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367395.735789:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787367395.736089:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787367395.736132:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787367395.736186:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787367395.736333:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787367395.736335:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787367395.736736:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787367395.736779:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787367395.736841:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787367395.737076:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787367395.737117:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787367395.737154:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787367395.737166:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787367395.737168:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787367395.738994:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787367395.739333:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787367395.739375:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787367395.739441:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787367395.739454:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787367395.739457:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787367395.740136:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787367395.740188:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787367395.740326:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787367395.740533:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787367395.740573:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787367395.740781:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1787367395.740808:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787367395.740877:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740897:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740906:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740912:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740919:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740925:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740933:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740967:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.740977:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.740988:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638592:0@lo:104: 00000100:00100000:0.0:1787367395.741042:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367395.741083:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.741094:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 16 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.741100:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638720:0@lo:104: 00010000:00010000:0.0:1787367395.741117:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.741122:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.741126:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638848:0@lo:104: 00010000:00010000:0.0:1787367395.741136:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.741140:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.741144:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638976:0@lo:104: 00010000:00010000:0.0:1787367395.741154:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.741158:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.741162:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446639104:0@lo:104: 00000100:00100000:0.0:1787367395.741171:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f918bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.741245:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787367395.741340:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.741370:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.741380:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.741400:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.741532:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638592 00000100:00100000:2.0:1787367395.741540:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638592 00000100:00100000:2.0:1787367395.741574:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638720 00000100:00100000:2.0:1787367395.741577:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638720 00000100:00100000:2.0:1787367395.741602:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638848 00000100:00100000:2.0:1787367395.741605:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638848 00000100:00100000:2.0:1787367395.741630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446638976 00000100:00100000:2.0:1787367395.741633:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446638976 00000100:00100000:2.0:1787367395.741717:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639104 00000100:00100000:2.0:1787367395.741720:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639104 00000100:00100000:2.0:1787367395.741736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367395.741744:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+7:5835:x1874190446638592:12345-0@lo:104: 00010000:00010000:2.0:1787367395.741756:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.741835:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367395.741841:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa00b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+7:5835:x1874190446638592:12345-0@lo:104: Request processed in 97us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.741849:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367395.741894:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367395.741900:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+6:5835:x1874190446638720:12345-0@lo:104: 00010000:00010000:0.0:1787367395.741907:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367395.741908:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367395.741955:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638592:0@lo:104: 00010000:00010000:2.0:1787367395.741959:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367395.741970:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638720:0@lo:104: 00000100:00100000:2.0:1787367395.741973:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+6:5835:x1874190446638720:12345-0@lo:104: Request processed in 71us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.741985:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367395.742000:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367395.742006:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+5:5835:x1874190446638848:12345-0@lo:104: 00010000:00010000:2.0:1787367395.742013:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.742052:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787367395.742057:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+5:5835:x1874190446638848:12345-0@lo:104: Request processed in 53us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.742062:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367395.742077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787367395.742083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:5835:x1874190446638976:12345-0@lo:104: 00000100:00100000:1.0:1787367395.742088:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638848:0@lo:104: 00010000:00010000:2.0:1787367395.742092:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.742131:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787367395.742135:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:5835:x1874190446638976:12345-0@lo:104: Request processed in 54us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.742141:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787367395.742156:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367395.742159:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446638976:0@lo:104: 00000100:00100000:2.0:1787367395.742166:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:5835:x1874190446639104:12345-0@lo:104: 00010000:00010000:2.0:1787367395.742174:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.742241:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787367395.742253:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:5835:x1874190446639104:12345-0@lo:104: Request processed in 88us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.742256:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5835:1874190446639104:0@lo:104: 00000100:00100000:2.0:1787367395.742262:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787367395.742311:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742417:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742431:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367395.742435:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742443:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367395.742450:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.742456:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367395.742487:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.742493:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787367395.742493:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367395.742512:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.742515:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446639232:0@lo:103: 00010000:00010000:0.0:1787367395.742519:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81496600/0xcbf1f1bac53f3592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3599 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742530:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787367395.742533:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742539:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367395.742541:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.742546:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367395.742558:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367395.742564:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.742569:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367395.742583:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742589:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367395.742597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639232 00000100:00100000:3.0:1787367395.742601:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639232 00010000:00010000:0.0:1787367395.742602:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742608:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f3553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f355a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742617:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367395.742620:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.742621:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742626:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367395.742628:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742635:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367395.742641:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.742651:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367395.742665:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742670:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367395.742696:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742703:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175400/0xcbf1f1bac53f3529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3530 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742714:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367395.742717:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742723:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2174c00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367395.742725:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.742728:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787367395.742732:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.742735:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+17:3312:x1874190446639232:12345-0@lo:103: 10000000:00010000:0.0:1787367395.742738:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.742743:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367395.742746:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367395.742750:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742754:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742759:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367395.742760:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742769:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.742774:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81497e00/0xcbf1f1bac53f3599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3592 expref: 17 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742775:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174c00/0xcbf1f1bac53f34ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3506 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.742785:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367395.742786:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367395.742787:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367395.742788:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367395.742811:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+16:3312:x1874190446639232:12345-0@lo:103: Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.742819:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367395.742840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446639360:0@lo:103: 00000100:00100000:3.0:1787367395.742922:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.742953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639360 00000100:00100000:3.0:1787367395.742958:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639360 00000100:00100000:1.0:1787367395.742967:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446639488:0@lo:103: 00010000:00010000:3.0:1787367395.742974:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.742996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367395.743003:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3313:x1874190446639360:12345-0@lo:103: 00010000:00010000:3.0:1787367395.743010:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367395.743014:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.743044:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.743054:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5f000/0xcbf1f1bac53f355a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3553 expref: 16 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.743063:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367395.743560:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446639616:0@lo:103: 00000100:00100000:1.0:1787367395.743716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.743734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.743746:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+15:3313:x1874190446639360:12345-0@lo:103: Request processed in 743us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.743754:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367395.743770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639488 00000100:00100000:3.0:1787367395.743775:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639488 00010000:00010000:3.0:1787367395.743792:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 15 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.743804:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639616 00000100:00100000:3.0:1787367395.743806:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639616 00000100:00100000:2.0:1787367395.743814:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446639232:0@lo:103: 00010000:00010000:3.0:1787367395.743819:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.743842:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367395.743899:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3310:x1874190446639488:12345-0@lo:103: 00000100:00100000:1.0:1787367395.743901:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787367395.743910:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787367395.743912:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367395.743918:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.743927:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.743941:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2174e00/0xcbf1f1bac53f3530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3529 expref: 16 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744013:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367395.744095:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+15:3310:x1874190446639488:12345-0@lo:103: Request processed in 245us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.744102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367395.744118:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367395.744127:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+14:3311:x1874190446639616:12345-0@lo:103: 00010000:00010000:3.0:1787367395.744136:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367395.744141:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744148:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744158:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f3506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f34ff expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744167:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367395.744221:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446639488:0@lo:103: 00000100:00100000:3.0:1787367395.744222:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+13:3311:x1874190446639616:12345-0@lo:103: Request processed in 98us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.744228:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367395.744252:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446639616:0@lo:103: 00000100:00100000:3.0:1787367395.744399:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446639360:0@lo:103: 00010000:00010000:0.0:1787367395.744463:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367395.744465:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367395.744466:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367395.744489:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744494:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367395.744502:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744507:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367395.744511:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367395.744515:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367395.744541:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744545:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787367395.744576:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446639744:0@lo:103: 00000100:00100000:0.0:1787367395.744595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787367395.744636:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367395.744651:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639744 00000100:00100000:2.0:1787367395.744657:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639744 00010000:00010000:2.0:1787367395.744676:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 13 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.744695:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f356f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3576 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367395.744702:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787367395.744710:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367395.744714:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367395.744714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+13:3312:x1874190446639744:12345-0@lo:103: 00010000:00010000:3.0:1787367395.744717:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367395.744726:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367395.744731:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 13 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744744:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 13 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744756:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f3576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f356f expref: 13 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744769:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744778:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744791:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744798:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744813:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744819:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744825:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80030800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367395.744829:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.744837:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.745518:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.745538:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787367395.745547:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787367395.746548:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.746562:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f35b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.746585:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367395.746673:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+12:3312:x1874190446639744:12345-0@lo:103: Request processed in 1959us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.746682:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367395.746766:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446639744:0@lo:103: 00000100:00100000:1.0:1787367395.797514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+11:7626:x1874190446638464:12345-0@lo:253: Request processed in 65995us (66344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.797531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367395.797748:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446638464:0@lo:253: 10000000:01000000:3.0:1787367395.797764:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787367395.797767:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367395.797768:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367395.797770:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367395.797771:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787367395.797772:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367395.797774:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367395.797775:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367395.797788:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787367395.797790:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367395.797791:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787367395.797811:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8fbf411800 from lustre-OST0001 10000000:01000000:3.0:1787367395.797834:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787367395.797837:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787367395.797844:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e8f9231cd28 local copy 10000000:01000000:3.0:1787367395.797848:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787367395.797893:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.797904:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.797913:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.797930:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446639872:0@lo:101: 00000100:00100000:3.0:1787367395.797965:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.798015:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.798135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446639872 00000100:00100000:0.0:1787367395.798141:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446639872 00000100:00100000:0.0:1787367395.799007:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787367395.799020:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+11:7626:x1874190446639872:12345-0@lo:101: 00010000:00010000:0.0:1787367395.799037:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367395.799059:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f35c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f35bc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.799084:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f35c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35bc expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.799096:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f35c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35bc expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.799105:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030600, rc 0) 00000100:00100000:0.0:1787367395.799164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446639872:12345-0@lo:101: Request processed in 149us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.799171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367395.799317:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446639872:0@lo:101: 00010000:00010000:3.0:1787367395.799332:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.799342:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.799510:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640000:0@lo:501: 00000100:00100000:3.0:1787367395.799673:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.799704:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367395.799822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640000 00000100:00100000:1.0:1787367395.799828:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640000 00000100:00100000:1.0:1787367395.799863:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787367395.799975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640000:12345-0@lo:501: 00000100:00100000:1.0:1787367395.800225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640000:12345-0@lo:501: Request processed in 220us (584us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367395.800386:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640000:0@lo:501: 10000000:01000000:3.0:1787367395.800415:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787367395.800443:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787367395.800449:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.800459:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.800465:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.800491:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367395.800511:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8fbf411800 10000000:01000000:3.0:1787367395.800515:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787367395.800521:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787367395.800523:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367395.800529:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787367395.800532:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787367395.800561:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.800568:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.800576:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.800589:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640128:0@lo:101: 00010000:00010000:2.0:1787367395.800761:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367395.800768:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.800776:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1787367395.800779:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.800792:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367395.800799:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367395.800805:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367395.800823:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.800829:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367395.800847:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.800871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e200/0xcbf1f1bac53f35bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcbf1f1bac53f35c3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.800885:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367395.800886:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367395.800888:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367395.800899:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446640256:0@lo:103: 00000100:00100000:2.0:1787367395.800930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.800974:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640256 00000100:00100000:2.0:1787367395.800978:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640256 00000100:00100000:2.0:1787367395.801008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367395.801015:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+13:3313:x1874190446640256:12345-0@lo:103: 00010000:00010000:2.0:1787367395.801024:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367395.801037:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f35c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f35bc expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.801054:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367395.801081:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+12:3313:x1874190446640256:12345-0@lo:103: Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.801087:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367395.801115:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446640256:0@lo:103: 00000100:00100000:3.0:1787367395.801283:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.801307:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.801388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640128 00000100:00100000:2.0:1787367395.801392:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640128 00000100:00100000:1.0:1787367395.801749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367395.801847:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787367395.801865:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+11:7626:x1874190446640128:12345-0@lo:101: 00010000:00010000:2.0:1787367395.801960:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367395.801975:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f35ca expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.801995:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.802005:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.802012:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496400, rc 0) 00000100:00100000:2.0:1787367395.802055:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640128:12345-0@lo:101: Request processed in 193us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.802061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787367395.802120:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640128:0@lo:101: 00010000:00010000:3.0:1787367395.802133:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.802141:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.802251:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640384:0@lo:501: 00000100:00100000:3.0:1787367395.802287:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.802427:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.802602:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640384 00000100:00100000:0.0:1787367395.802676:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640384 00000100:00100000:0.0:1787367395.802700:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787367395.802708:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640384:12345-0@lo:501: 00000100:00100000:0.0:1787367395.803030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640384:12345-0@lo:501: Request processed in 322us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.803037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787367395.803113:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640384:0@lo:501: 00000100:00100000:3.0:1787367395.803143:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640512:0@lo:503: 00000100:00100000:3.0:1787367395.803182:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.803226:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.803287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640512 00000100:00100000:0.0:1787367395.803291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640512 00000100:00100000:0.0:1787367395.803307:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787367395.803313:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640512:12345-0@lo:503: 00000100:00100000:0.0:1787367395.803625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640512:12345-0@lo:503: Request processed in 311us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.803632:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787367395.804085:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640512:0@lo:503: 00000040:00080000:3.0:1787367395.804426:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787367395.804492:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640640:0@lo:502: 00000100:00100000:3.0:1787367395.804544:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.804563:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.804809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640640 00000100:00100000:2.0:1787367395.804814:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640640 00000100:00100000:2.0:1787367395.804849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367395.804858:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640640:12345-0@lo:502: 00000100:00100000:2.0:1787367395.805099:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640640:12345-0@lo:502: Request processed in 243us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.805107:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367395.805229:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640640:0@lo:502: 00000040:00080000:3.0:1787367395.805816:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787367395.805941:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787367395.805980:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787367395.806031:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787367395.806069:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787367395.806103:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787367395.806142:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640768:0@lo:502: 00000100:00100000:3.0:1787367395.806332:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.806401:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.806490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640768 00000100:00100000:2.0:1787367395.806495:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640768 00000100:00100000:2.0:1787367395.806696:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367395.806705:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640768:12345-0@lo:502: 00000100:00100000:2.0:1787367395.806881:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640768:12345-0@lo:502: Request processed in 178us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.806889:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787367395.806968:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640768:0@lo:502: 00000040:00080000:3.0:1787367395.807057:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787367395.807068:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787367395.807808:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787367395.807817:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787367395.807823:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367395.807826:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787367395.807832:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787367395.807846:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e8fbf640000) 00000020:00000080:3.0:1787367395.807917:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787367395.807925:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787367395.807985:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fbf411800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787367395.807992:0:7635:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787367395.808014:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbf1f1bac53f35df 00010000:00010000:3.0:1787367395.813403:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787367395.813815:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787367395.816742:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787367395.817027:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787367395.821103:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787367395.822187:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787367395.823695:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787367395.823706:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367395.823713:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367395.823715:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787367395.823719:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367395.823722:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367395.823723:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787367395.823726:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787367395.823733:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787367395.823783:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367395.823788:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367395.823789:0:7635:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787367395.823792:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787367395.824000:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787367395.824022:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787367395.824050:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824062:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.824071:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbf411800 from 1 10000000:01000000:0.0:1787367395.824074:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367395.824109:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824117:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824128:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.824152:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640896:0@lo:101: 00000100:00100000:0.0:1787367395.824251:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.824300:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f918bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.824567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446640896 00000100:00100000:0.0:1787367395.824573:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446640896 00000100:00100000:0.0:1787367395.824628:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787367395.824636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+12:7626:x1874190446640896:12345-0@lo:101: 00010000:00010000:0.0:1787367395.824649:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367395.824661:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f35e6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824685:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824707:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824716:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030e00, rc 0) 00000100:00100000:0.0:1787367395.824756:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446640896:12345-0@lo:101: Request processed in 121us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.824763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787367395.824807:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446640896:0@lo:101: 00010000:00010000:0.0:1787367395.824820:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.824829:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.824914:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641024:0@lo:501: 00000100:00100000:0.0:1787367395.824940:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.824961:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f918bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367395.825134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641024 00000100:00100000:3.0:1787367395.825139:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641024 00000100:00100000:3.0:1787367395.825168:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787367395.825175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641024:12345-0@lo:501: 00000100:00100000:3.0:1787367395.825403:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641024:12345-0@lo:501: Request processed in 227us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.825423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787367395.825720:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641024:0@lo:501: 00000100:00100000:0.0:1787367395.825751:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641152:0@lo:503: 00000100:00100000:0.0:1787367395.825791:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.825817:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f918bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367395.825864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641152 00000100:00100000:3.0:1787367395.825868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641152 00000100:00100000:3.0:1787367395.825897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787367395.825904:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641152:12345-0@lo:503: 00000100:00100000:3.0:1787367395.826189:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641152:12345-0@lo:503: Request processed in 284us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.826218:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787367395.826336:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641152:0@lo:503: 00000040:00080000:1.0:1787367395.826802:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787367395.826861:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641280:0@lo:502: 00000100:00100000:1.0:1787367395.826907:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367395.826938:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367395.826993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641280 00000100:00100000:3.0:1787367395.826998:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641280 00000100:00100000:3.0:1787367395.827071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787367395.827079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641280:12345-0@lo:502: 00000100:00100000:3.0:1787367395.827293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641280:12345-0@lo:502: Request processed in 214us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.827300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787367395.827374:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641280:0@lo:502: 00000040:00080000:1.0:1787367395.830017:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787367395.830104:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787367395.830155:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641408:0@lo:502: 00000100:00100000:1.0:1787367395.830240:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367395.831028:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.831088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641408 00000100:00100000:0.0:1787367395.831095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641408 00000100:00100000:0.0:1787367395.831138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787367395.831147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641408:12345-0@lo:502: 00000100:00100000:0.0:1787367395.831382:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641408:12345-0@lo:502: Request processed in 235us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.831395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787367395.831565:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641408:0@lo:502: 00000040:00080000:1.0:1787367395.831694:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787367395.831707:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787367395.835661:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367395.835674:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367395.835677:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787367395.835684:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fbf411800 00000020:00000080:1.0:1787367395.835686:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787367395.835706:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367395.835709:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367395.835711:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787367395.835714:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787367395.835936:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787367395.835975:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367395.835999:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.836012:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.836054:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787367395.836057:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8fbf411800 10000000:01000000:0.0:1787367395.836060:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8fbf411800 10000000:01000000:0.0:1787367395.836064:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367395.836069:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fbf411800 from 1 10000000:01000000:0.0:1787367395.836072:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367395.836105:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.836114:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.836125:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.836150:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641536:0@lo:101: 00000100:00100000:0.0:1787367395.836293:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.836331:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367395.836792:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641536 00000100:00100000:1.0:1787367395.836800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641536 00000100:00100000:1.0:1787367395.836849:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787367395.836858:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446641536:12345-0@lo:101: 00010000:00010000:1.0:1787367395.836875:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367395.836890:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f35f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367395.836916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367395.836928:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367395.836938:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e400, rc 0) 00000100:00100000:1.0:1787367395.837006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641536:12345-0@lo:101: Request processed in 149us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.837013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787367395.837108:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641536:0@lo:101: 00010000:00010000:0.0:1787367395.837122:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.837136:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.837285:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641664:0@lo:501: 00000100:00100000:0.0:1787367395.837312:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.837335:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367395.837401:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641664 00000100:00100000:1.0:1787367395.837683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641664 00000100:00100000:1.0:1787367395.837707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787367395.837714:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641664:12345-0@lo:501: 00000100:00100000:1.0:1787367395.838729:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641664:12345-0@lo:501: Request processed in 1009us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.838739:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787367395.841253:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641664:0@lo:501: 00000100:00100000:0.0:1787367395.841325:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641792:0@lo:503: 00000100:00100000:0.0:1787367395.841403:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.841451:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.841696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641792 00000100:00100000:2.0:1787367395.841703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641792 00000100:00100000:2.0:1787367395.841755:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787367395.841765:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641792:12345-0@lo:503: 00000100:00100000:2.0:1787367395.841947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641792:12345-0@lo:503: Request processed in 184us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.841954:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787367395.842139:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641792:0@lo:503: 00000040:00080000:0.0:1787367395.842491:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787367395.842549:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641920:0@lo:502: 00000100:00100000:0.0:1787367395.842588:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367395.842695:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446641920 00000100:00100000:1.0:1787367395.842700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446641920 00000100:00100000:1.0:1787367395.842727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787367395.842734:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641920:12345-0@lo:502: 00000100:00100000:1.0:1787367395.842896:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446641920:12345-0@lo:502: Request processed in 163us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.842903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787367395.843015:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367395.843028:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446641920:0@lo:502: 00000040:00080000:0.0:1787367395.843311:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787367395.843357:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787367395.843390:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787367395.843502:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787367395.843540:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787367395.843586:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787367395.843739:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787367395.843776:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787367395.843825:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787367395.843862:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787367395.843905:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787367395.843954:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787367395.843993:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787367395.844038:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787367395.844085:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787367395.844121:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787367395.844155:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787367395.844231:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787367395.844276:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787367395.844310:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787367395.844355:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787367395.844390:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787367395.844777:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787367395.844827:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787367395.844862:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787367395.844895:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787367395.844959:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787367395.844999:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787367395.845032:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787367395.845094:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787367395.845130:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787367395.845163:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787367395.845359:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787367395.845491:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787367395.845529:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787367395.845718:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787367395.845756:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787367395.845799:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446642048:0@lo:502: 00000100:00100000:0.0:1787367395.845876:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.845955:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367395.847718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642048 00000100:00100000:1.0:1787367395.847729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642048 00000100:00100000:1.0:1787367395.847824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787367395.847835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446642048:12345-0@lo:502: 00000100:00100000:1.0:1787367395.848115:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446642048:12345-0@lo:502: Request processed in 282us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.848124:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787367395.848454:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446642048:0@lo:502: 00000040:00080000:2.0:1787367395.848572:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787367395.848586:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787367395.851485:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787367395.851502:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e8fb3538000) 00000020:00000080:2.0:1787367395.851524:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787367395.851774:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fbf411800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367395.851779:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8fbf411800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787367395.851782:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fbf411800 3 00010000:00080000:2.0:1787367395.851820:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fb3363000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.123@tcp at head 00010000:00010000:0.0:1787367395.856390:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787367395.856781:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787367395.856835:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787367395.856847:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbf1f1bac53f3609 00000100:00080000:0.0:1787367395.856858:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787367395.856864:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e8fb3363000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1787367395.856901:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fb3c82680 x1874190446642176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787367395.856929:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787367395.857521:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446642176:0@lo:38: 00000100:00100000:2.0:1787367395.857708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.857769:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446642560:0@lo:400: 00000100:00100000:2.0:1787367395.857794:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.857827:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642176 00000100:00100000:2.0:1787367395.857833:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642176 00000100:00100000:2.0:1787367395.857865:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367395.857873:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1874190446642176:12345-0@lo:38: 00010000:00080000:2.0:1787367395.857896:0:6718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1787367395.857923:0:6718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbf1f1bac53f3610 00000004:00100000:2.0:1787367395.857938:0:6718:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787367395.857966:0:6718:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3360000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367395.858012:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874190446642176:12345-0@lo:38: Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.858019:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367395.858038:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642560 00000100:00100000:2.0:1787367395.858041:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642560 00000100:00100000:2.0:1787367395.858078:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367395.858084:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446642560:12345-0@lo:400: 00000100:00100000:2.0:1787367395.858116:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446642560:12345-0@lo:400: Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.858121:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787367395.858153:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a59500 x1874190446642560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367395.858165:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446642560:0@lo:400: 00010000:00080000:2.0:1787367395.858188:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb3c82680 x1874190446642176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367395.858236:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367395.858242:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787367395.858248:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787367395.858253:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787367395.858255:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787367395.858261:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446642176:0@lo:38: 00000100:00100000:0.0:1787367395.858394:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446642304:0@lo:400: 00000100:00100000:0.0:1787367395.858435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.858462:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367395.858468:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446642432:0@lo:400: 00000100:00100000:0.0:1787367395.858488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367395.858723:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642304 00000100:00100000:1.0:1787367395.858728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642304 00000100:00100000:1.0:1787367395.858761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642432 00000100:00100000:1.0:1787367395.858764:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642432 00000100:00100000:1.0:1787367395.858790:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787367395.858797:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446642304:12345-0@lo:400: 00000100:00100000:1.0:1787367395.858839:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446642304:12345-0@lo:400: Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.858844:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787367395.858858:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367395.858864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446642432:12345-0@lo:400: 00000100:00100000:1.0:1787367395.858890:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446642432:12345-0@lo:400: Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367395.858895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787367395.858918:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a59180 x1874190446642432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367395.858928:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446642432:0@lo:400: 00010000:00080000:1.0:1787367395.858938:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb2a59880 x1874190446642304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367395.858945:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446642304:0@lo:400: 00000040:00080000:1.0:1787367395.859564:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787367395.859844:0:7641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1874190446642688:0@lo:901: 00000100:00100000:0.0:1787367395.859911:0:7641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367395.859935:0:7641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84dd8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367395.862323:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642688 00000100:00100000:3.0:1787367395.862338:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642688 00000100:00100000:3.0:1787367395.862414:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367395.862430:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1874190446642688:12345-0@lo:901: 00000100:00080000:1.0:1787367395.862640:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367395.863051:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1874190446642688:12345-0@lo:901: Request processed in 622us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.863060:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787367395.863109:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fb3c82a00 x1874190446642688/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787367411 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367395.863125:0:7641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1874190446642688:0@lo:901: 00000020:01000000:2.0:1787367395.863511:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787367395.863547:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367395.863566:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.863577:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787367395.863760:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787367395.863763:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787367395.863764:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367395.863765:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367395.863766:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367395.863768:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367395.863769:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367395.863770:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787367395.863772:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787367395.863773:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367395.863775:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787367395.863778:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787367395.863781:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787367395.863782:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787367395.863783:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367395.863785:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367395.863786:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367395.863787:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367395.863791:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367395.863792:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787367395.863793:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787367395.863794:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367395.863795:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787367395.863815:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787367395.863829:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446642816:0@lo:253: 00000100:00100000:2.0:1787367395.863875:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367395.863910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642816 00000100:00100000:2.0:1787367395.863915:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642816 00000100:00100000:2.0:1787367395.863961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787367395.863969:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:7626:x1874190446642816:12345-0@lo:253: 20000000:01000000:2.0:1787367395.864007:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787367395.864022:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787367395.866321:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f94daab40 going to sleep for 11 seconds 20000000:01000000:2.0:1787367395.893239:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787367395.893251:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787367395.893323:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787367395.893328:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787367395.893351:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.893370:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.893379:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.893431:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.893446:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.893461:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446642944:0@lo:104: 00000100:00100000:3.0:1787367395.893528:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.893582:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa01bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367395.894370:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446642944 00000100:00100000:2.0:1787367395.894380:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446642944 00000100:00100000:2.0:1787367395.894444:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367395.894453:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446642944:12345-0@lo:104: 00010000:00010000:2.0:1787367395.894466:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367395.894529:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367395.894546:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:5857:x1874190446642944:12345-0@lo:104: Request processed in 95us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367395.894554:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787367395.894624:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367395.894631:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.894639:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367395.894642:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.894651:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367395.894658:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367395.894682:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367395.894717:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.894723:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367395.894739:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.894746:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f3561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3568 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367395.894761:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367395.894763:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367395.894764:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367395.894774:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446643072:0@lo:103: 00000100:00100000:0.0:1787367395.894809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367395.895103:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643072 00000100:00100000:3.0:1787367395.895108:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643072 00010000:00010000:3.0:1787367395.895133:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 15 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.895162:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787367395.895170:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89d46cbb-4841-4af3-a474-32a0415d3217+15:3313:x1874190446643072:12345-0@lo:103: 00010000:00010000:3.0:1787367395.895181:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367395.895186:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 15 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895235:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 15 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895252:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895261:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787367395.895284:0:7633:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005165467s 00010000:00010000:3.0:1787367395.895288:0:7633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895295:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895303:0:7633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895309:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895315:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367395.895324:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895332:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895341:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895351:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367395.895389:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89d46cbb-4841-4af3-a474-32a0415d3217+15:3313:x1874190446643072:12345-0@lo:103: Request processed in 220us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367395.895396:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787367395.895840:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2175600/0xcbf1f1bac53f3568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3561 expref: 14 pid: 5836 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367395.895854:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1874190446642944:0@lo:104: 00010000:00010000:3.0:1787367395.895871:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895879:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895885:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367395.895891:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f3617 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367395.896810:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446643072:0@lo:103: 00000100:00100000:0.0:1787367395.902916:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:7626:x1874190446642816:12345-0@lo:253: Request processed in 38939us (39032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367395.902930:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787367395.903015:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89d46cbb-4841-4af3-a474-32a0415d3217:7626:1874190446642816:0@lo:253: 10000000:01000000:3.0:1787367395.903029:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787367395.903045:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367395.903047:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367395.903048:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367395.903049:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367395.903050:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367395.903051:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367395.903053:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367395.903054:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787367395.903055:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787367395.903057:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367395.903058:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787367395.903071:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787367395.908721:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367395.908921:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367395.909170:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367395.909523:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367395.909839:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367395.910069:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787367395.911746:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787367395.973866:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787367396.083008:0:7626:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787367396.083017:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787367396.083050:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787367396.083110:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787367396.083133:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787367396.083158:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787367396.996799:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367398.021049:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367399.044861:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367399.492381:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367399.492416:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446643200:0@lo:13: 00000100:00100000:0.0:1787367399.492857:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367399.492943:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643200 00000100:00100000:0.0:1787367399.492951:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643200 00000100:00100000:0.0:1787367399.493014:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367399.493026:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446643200:12345-0@lo:13: 00002000:00000024:0.0:1787367399.493064:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367399.493112:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446643200:12345-0@lo:13: Request processed in 90us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367399.493121:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787367399.493142:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787367399.493172:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c83480 x1874190446643200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367399.493492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446643200:0@lo:13: 00010000:00010000:0.0:1787367400.072012:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367401.028781:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367401.028820:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446643712:0@lo:400: 00000100:00100000:3.0:1787367401.028917:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367401.028997:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446643328:0@lo:400: 00000100:00100000:1.0:1787367401.029044:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643712 00000100:00100000:1.0:1787367401.029054:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643712 00000100:00100000:1.0:1787367401.029134:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367401.029147:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446643712:12345-0@lo:400: 00000100:00100000:0.0:1787367401.030058:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446643840:0@lo:400: 00000100:00100000:1.0:1787367401.033981:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446643712:12345-0@lo:400: Request processed in 4821us (5049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367401.034004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367401.037339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787367401.037473:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a5ad80 x1874190446643712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367401.037494:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446643712:0@lo:400: 00000100:00100000:1.0:1787367401.037961:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643328 00000100:00100000:1.0:1787367401.037973:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643328 00000100:00100000:1.0:1787367401.038043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787367401.038057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:3310:x1874190446643328:12345-0@lo:400: 00000100:00100000:1.0:1787367401.038185:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:3310:x1874190446643328:12345-0@lo:400: Request processed in 130us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367401.038216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787367401.038236:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446643328:0@lo:400: 00000100:00100000:1.0:1787367401.039761:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446643584:0@lo:400: 00000100:00100000:1.0:1787367401.039846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367401.039897:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367401.039905:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446643456:0@lo:400: 00000100:00100000:1.0:1787367401.039929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367401.039973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643584 00000100:00100000:1.0:1787367401.039981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643584 00000100:00100000:1.0:1787367401.040036:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643456 00000100:00100000:1.0:1787367401.040040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643456 00000100:00100000:1.0:1787367401.040069:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367401.040079:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446643584:12345-0@lo:400: 00000100:00100000:1.0:1787367401.040138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446643584:12345-0@lo:400: Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367401.040146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367401.040173:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787367401.040181:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446643456:12345-0@lo:400: 00000100:00100000:1.0:1787367401.040235:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446643456:12345-0@lo:400: Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367401.040242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787367401.040290:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a59180 x1874190446643456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367401.040335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446643456:0@lo:400: 00010000:00080000:1.0:1787367401.040349:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a5a680 x1874190446643584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367401.040358:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446643584:0@lo:400: 00000100:00080000:0.0:1787367401.041444:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367401.041455:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367401.041539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367401.041687:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643840 00000100:00100000:1.0:1787367401.041697:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643840 00000100:00100000:1.0:1787367401.041758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367401.041768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446643840:12345-0@lo:400: 00000100:00100000:1.0:1787367401.041829:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446643840:12345-0@lo:400: Request processed in 62us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367401.041836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787367401.041900:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787367401.041943:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a58380 x1874190446643840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367401.041959:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446643840:0@lo:400: 00010000:00010000:0.0:1787367401.092011:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787367402.066828:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787367402.066839:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fb88be800 from 30 10000000:01000000:0.0:1787367402.066846:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367402.066917:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.066932:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.066945:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367402.066975:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446643968:0@lo:101: 00000100:00100000:0.0:1787367402.067072:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.067160:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.067362:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446643968 00000100:00100000:2.0:1787367402.067372:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446643968 00000100:00100000:2.0:1787367402.067446:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787367402.067469:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446643968:12345-0@lo:101: 00010000:00010000:2.0:1787367402.067488:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367402.067504:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f361e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.067536:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.067548:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.067559:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497400, rc 0) 00000100:00100000:2.0:1787367402.067612:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446643968:12345-0@lo:101: Request processed in 144us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.067619:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787367402.067894:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446643968:0@lo:101: 00010000:00010000:0.0:1787367402.067912:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.067923:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367402.067994:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644096:0@lo:501: 00000100:00100000:0.0:1787367402.068025:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.068057:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.068375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644096 00000100:00100000:2.0:1787367402.068380:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644096 00000100:00100000:2.0:1787367402.068420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787367402.068428:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446644096:12345-0@lo:501: 00000100:00100000:2.0:1787367402.068988:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446644096:12345-0@lo:501: Request processed in 557us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.068995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787367402.069434:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644096:0@lo:501: 00000100:00100000:0.0:1787367402.069483:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644224:0@lo:503: 00000100:00100000:0.0:1787367402.069538:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.069565:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.069637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644224 00000100:00100000:2.0:1787367402.069644:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644224 00000100:00100000:2.0:1787367402.069686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787367402.069694:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446644224:12345-0@lo:503: 00000100:00100000:2.0:1787367402.070098:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446644224:12345-0@lo:503: Request processed in 404us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.070117:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787367402.070511:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644224:0@lo:503: 00000100:00100000:0.0:1787367402.077625:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7926:1874190446644352:0@lo:502: 00000100:00100000:0.0:1787367402.077757:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.077884:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f94daa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.078887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644352 00000100:00100000:2.0:1787367402.078901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644352 00000100:00100000:2.0:1787367402.078988:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787367402.078999:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:7926:x1874190446644352:12345-0@lo:502: 00000100:00100000:2.0:1787367402.080121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:7926:x1874190446644352:12345-0@lo:502: Request processed in 1117us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.080134:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787367402.085251:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7926:1874190446644352:0@lo:502: 00000100:00100000:3.0:1787367402.090237:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7926:1874190446644480:0@lo:502: 00000100:00100000:3.0:1787367402.090637:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.090699:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.090789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644480 00000100:00100000:2.0:1787367402.090801:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644480 00000100:00100000:2.0:1787367402.090879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787367402.090891:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:7926:x1874190446644480:12345-0@lo:502: 00000100:00100000:2.0:1787367402.091275:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:7926:x1874190446644480:12345-0@lo:502: Request processed in 385us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.091564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787367402.091779:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7926:1874190446644480:0@lo:502: 00000040:00080000:3.0:1787367402.091829:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787367402.093672:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787367402.093717:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367402.093734:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.093746:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367402.093761:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787367402.093766:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787367402.093769:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367402.093823:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.093862:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.093875:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367402.093905:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644608:0@lo:101: 00000100:00100000:2.0:1787367402.093995:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.094043:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.094069:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644608 00000100:00100000:2.0:1787367402.094077:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644608 00000100:00100000:2.0:1787367402.094130:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787367402.094923:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446644608:12345-0@lo:101: 00010000:00010000:2.0:1787367402.094951:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367402.094974:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f362c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.095008:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.095020:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.095030:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496600, rc 0) 00000100:00100000:2.0:1787367402.095101:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446644608:12345-0@lo:101: Request processed in 962us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.095110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787367402.096615:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644608:0@lo:101: 00010000:00010000:2.0:1787367402.096658:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.096673:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367402.096765:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644736:0@lo:501: 00000100:00100000:2.0:1787367402.096829:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.096871:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.097558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644736 00000100:00100000:3.0:1787367402.097568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644736 00000100:00100000:3.0:1787367402.097640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367402.097659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446644736:12345-0@lo:501: 00000100:00100000:3.0:1787367402.098056:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446644736:12345-0@lo:501: Request processed in 398us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.098065:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367402.098412:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644736:0@lo:501: 00000100:00100000:2.0:1787367402.103052:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644864:0@lo:503: 00000100:00100000:2.0:1787367402.103173:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.103267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644864 00000100:00100000:2.0:1787367402.103277:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644864 00000100:00100000:2.0:1787367402.104427:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367402.104447:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446644864:12345-0@lo:503: 00000100:00100000:2.0:1787367402.106976:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446644864:12345-0@lo:503: Request processed in 2522us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.106996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787367402.107079:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.107112:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446644864:0@lo:503: 00010000:00010000:2.0:1787367402.116990:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367402.117343:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7929:1874190446644992:0@lo:502: 00000100:00100000:3.0:1787367402.117471:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.117518:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.117957:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446644992 00000100:00100000:2.0:1787367402.117966:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446644992 00000100:00100000:2.0:1787367402.118036:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787367402.118047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:7929:x1874190446644992:12345-0@lo:502: 00000100:00100000:2.0:1787367402.118471:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:7929:x1874190446644992:12345-0@lo:502: Request processed in 424us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.118491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787367402.118704:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7929:1874190446644992:0@lo:502: 00000020:01000000:3.0:1787367402.118746:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367402.118759:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367402.118762:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787367402.118768:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787367402.118771:0:7929:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787367402.118810:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7929:1874190446645120:0@lo:502: 00000100:00100000:3.0:1787367402.118856:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.118893:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf544180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.119014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645120 00000100:00100000:2.0:1787367402.119020:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645120 00000100:00100000:2.0:1787367402.119059:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787367402.119068:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:7929:x1874190446645120:12345-0@lo:502: 00000100:00100000:2.0:1787367402.119259:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:7929:x1874190446645120:12345-0@lo:502: Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.119267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787367402.119450:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7929:1874190446645120:0@lo:502: 00000020:01000000:3.0:1787367402.119474:0:7929:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367402.119479:0:7929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367402.119480:0:7929:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787367402.119484:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787367402.119900:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787367402.119922:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787367402.119935:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.119947:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367402.119959:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787367402.119963:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f92200800 from 30 10000000:01000000:2.0:1787367402.119966:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367402.119999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.120008:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.120020:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367402.120037:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645248:0@lo:101: 00000100:00100000:2.0:1787367402.120095:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.120133:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.123001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645248 00000100:00100000:3.0:1787367402.123023:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645248 00000100:00100000:3.0:1787367402.123123:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787367402.123136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446645248:12345-0@lo:101: 00010000:00010000:3.0:1787367402.123170:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367402.123234:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f363a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.123273:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.123288:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.123299:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367402.123405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645248:12345-0@lo:101: Request processed in 272us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.123412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787367402.123723:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645248:0@lo:101: 00010000:00010000:2.0:1787367402.123751:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.123762:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367402.123868:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645376:0@lo:501: 00000100:00100000:2.0:1787367402.123909:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.123957:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.124080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645376 00000100:00100000:3.0:1787367402.124086:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645376 00000100:00100000:3.0:1787367402.124125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787367402.124133:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645376:12345-0@lo:501: 00000100:00100000:3.0:1787367402.124499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645376:12345-0@lo:501: Request processed in 366us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.124506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787367402.124667:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645376:0@lo:501: 00000100:00100000:2.0:1787367402.124702:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645504:0@lo:503: 00000100:00100000:2.0:1787367402.124751:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.124858:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.126169:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645504 00000100:00100000:3.0:1787367402.126185:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645504 00000100:00100000:3.0:1787367402.126264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787367402.126274:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645504:12345-0@lo:503: 00000100:00100000:3.0:1787367402.126586:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645504:12345-0@lo:503: Request processed in 313us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.126595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787367402.126826:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645504:0@lo:503: 00000100:00100000:3.0:1787367402.135472:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7930:1874190446645632:0@lo:502: 00000100:00100000:3.0:1787367402.135605:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.135672:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.135809:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645632 00000100:00100000:0.0:1787367402.135819:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645632 00000100:00100000:0.0:1787367402.135910:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787367402.135921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:7930:x1874190446645632:12345-0@lo:502: 00000100:00100000:0.0:1787367402.136305:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:7930:x1874190446645632:12345-0@lo:502: Request processed in 383us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.136314:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787367402.137934:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7930:1874190446645632:0@lo:502: 00000100:00100000:3.0:1787367402.138110:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7930:1874190446645760:0@lo:502: 00000100:00100000:3.0:1787367402.138227:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.138269:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.138881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645760 00000100:00100000:0.0:1787367402.138892:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645760 00000100:00100000:0.0:1787367402.138964:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787367402.138975:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:7930:x1874190446645760:12345-0@lo:502: 00000100:00100000:0.0:1787367402.139357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:7930:x1874190446645760:12345-0@lo:502: Request processed in 381us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.139366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787367402.140016:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7930:1874190446645760:0@lo:502: 00000040:00080000:3.0:1787367402.140062:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787367402.140755:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787367402.140779:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367402.140795:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.140809:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367402.140821:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367402.140824:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8f92200800 from 5 10000000:01000000:2.0:1787367402.140836:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367402.141009:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.141019:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367402.141031:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367402.141055:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645888:0@lo:101: 00000100:00100000:2.0:1787367402.141125:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.142015:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.142340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446645888 00000100:00100000:0.0:1787367402.142350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446645888 00000100:00100000:0.0:1787367402.142506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787367402.142518:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446645888:12345-0@lo:101: 00010000:00010000:0.0:1787367402.142537:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367402.142561:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f364f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3648 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.142595:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f364f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3648 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.142608:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f364f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3648 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.142619:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030800, rc 0) 00000100:00100000:0.0:1787367402.142695:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446645888:12345-0@lo:101: Request processed in 179us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.142703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787367402.142815:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446645888:0@lo:101: 00010000:00010000:3.0:1787367402.142841:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.144467:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367402.144587:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646016:0@lo:256: 00000100:00100000:3.0:1787367402.144664:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.144709:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.144911:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646016 00000100:00100000:0.0:1787367402.144920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646016 00000100:00100000:0.0:1787367402.144985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787367402.144996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446646016:12345-0@lo:256: 20000000:01000000:0.0:1787367402.145020:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787367402.145042:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787367402.145046:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787367402.145160:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446646016:12345-0@lo:256: Request processed in 165us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.145168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367402.145501:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646016:0@lo:256: 10000000:01000000:3.0:1787367402.145560:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367402.145571:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.145581:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367402.145603:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787367402.145607:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787367402.145609:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787367402.145639:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.145648:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.145658:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367402.145673:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646144:0@lo:101: 00000100:00100000:3.0:1787367402.145707:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.145736:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.145976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646144 00000100:00100000:0.0:1787367402.145982:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646144 00000100:00100000:0.0:1787367402.146021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787367402.146035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446646144:12345-0@lo:101: 00010000:00010000:0.0:1787367402.146046:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367402.146061:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3656 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.146085:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.146096:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367402.146105:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80030600, rc 0) 00000100:00100000:0.0:1787367402.146157:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446646144:12345-0@lo:101: Request processed in 124us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.146164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787367402.146320:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646144:0@lo:101: 00010000:00010000:3.0:1787367402.146333:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.146344:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367402.146398:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646272:0@lo:501: 00000100:00100000:3.0:1787367402.146439:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.146461:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.146575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646272 00000100:00100000:2.0:1787367402.146581:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646272 00000100:00100000:2.0:1787367402.146618:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787367402.146626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446646272:12345-0@lo:501: 00000100:00100000:2.0:1787367402.146958:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446646272:12345-0@lo:501: Request processed in 332us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.146965:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787367402.147178:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646272:0@lo:501: 00000100:00100000:3.0:1787367402.147242:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646400:0@lo:503: 00000100:00100000:3.0:1787367402.147289:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.147312:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.149816:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646400 00000100:00100000:2.0:1787367402.149838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646400 00000100:00100000:2.0:1787367402.149923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787367402.149934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446646400:12345-0@lo:503: 00000100:00100000:2.0:1787367402.151620:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446646400:12345-0@lo:503: Request processed in 1677us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.151637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787367402.154788:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446646400:0@lo:503: 00000100:00100000:0.0:1787367402.160545:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7931:1874190446646528:0@lo:502: 00000100:00100000:0.0:1787367402.160660:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.160715:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e8b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.160777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646528 00000100:00100000:3.0:1787367402.160788:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646528 00000100:00100000:3.0:1787367402.160853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367402.160864:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:7931:x1874190446646528:12345-0@lo:502: 00000100:00100000:3.0:1787367402.161327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:7931:x1874190446646528:12345-0@lo:502: Request processed in 464us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.161336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787367402.161515:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7931:1874190446646528:0@lo:502: 00000020:01000000:2.0:1787367402.161566:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787367402.161576:0:7931:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787367402.161586:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367402.161589:0:7931:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787367402.161596:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787367402.161600:0:7931:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:2.0:1787367402.161629:0:7931:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787367402.161633:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367402.161653:0:7931:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e8fb353b370) 00000020:00000080:2.0:1787367402.161681:0:7931:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787367402.161686:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787367402.161780:0:7931:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787367402.161787:0:7931:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787367402.161795:0:7931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f366b 00010000:00080000:2.0:1787367402.161834:0:7931:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fb3364800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1787367402.162098:0:7931:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787367402.162538:0:7931:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787367402.162554:0:7931:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787367402.163157:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367402.163437:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367402.163494:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787367402.163560:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787367402.169026:0:7932:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367402.169039:0:7932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787367402.177776:0:7931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787367402.177799:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787367402.177867:0:7931:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787367402.177927:0:7931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f3672 00000100:00080000:2.0:1787367402.177941:0:7931:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367402.177949:0:7931:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb3364800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367402.178007:0:7931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8f83f5c700 x1874190446646656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367402.178045:0:7931:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787367402.178244:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446646784:0@lo:400: 00000100:00100000:2.0:1787367402.178330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.178382:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367402.178388:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446646912:0@lo:400: 00000100:00100000:2.0:1787367402.178416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.178456:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646784 00000100:00100000:2.0:1787367402.178464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646784 00000100:00100000:2.0:1787367402.178511:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646912 00000100:00100000:2.0:1787367402.178514:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646912 00000100:00100000:2.0:1787367402.178541:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787367402.178551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446646784:12345-0@lo:400: 00000100:00100000:0.0:1787367402.178841:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446646656:0@lo:8: 00000100:00100000:0.0:1787367402.179175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.179256:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446647168:0@lo:400: 00000100:00100000:0.0:1787367402.179288:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.179303:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367402.179310:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446647040:0@lo:400: 00000100:00100000:0.0:1787367402.179333:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.179369:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647168 00000100:00100000:0.0:1787367402.179386:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647168 00000100:00100000:0.0:1787367402.179418:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367402.179425:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446646912:12345-0@lo:400: 00000100:00100000:0.0:1787367402.179478:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446646912:12345-0@lo:400: Request processed in 52us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.179486:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367402.179504:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367402.179510:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446647168:12345-0@lo:400: 00000100:00100000:0.0:1787367402.179541:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446647168:12345-0@lo:400: Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.179547:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367402.179568:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446646656 00000100:00100000:0.0:1787367402.179572:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446646656 00000100:00100000:0.0:1787367402.179840:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647040 00000100:00100000:0.0:1787367402.179845:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647040 00000100:00100000:0.0:1787367402.179937:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367402.179944:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446647040:12345-0@lo:400: 00000100:00100000:0.0:1787367402.179981:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446647040:12345-0@lo:400: Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.179987:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367402.179999:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367402.180003:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874190446646656:12345-0@lo:8: 00010000:00080000:0.0:1787367402.180032:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1787367402.180068:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f3679 00002000:00100000:0.0:1787367402.180087:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e8f91dbc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787367402.180092:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787367402.180106:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787367402.180390:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787367402.180742:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446646784:12345-0@lo:400: Request processed in 2190us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.180751:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:2.0:1787367402.180990:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367402.180999:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367402.181001:0:7931:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787367402.181005:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367402.181010:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367402.181011:0:7931:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367402.181014:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367402.181016:0:7931:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787367402.181057:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7931:1874190446647296:0@lo:502: 00000100:00100000:2.0:1787367402.181124:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.181359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647296 00000100:00100000:2.0:1787367402.181372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647296 00000100:00100000:2.0:1787367402.181411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787367402.181418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:7931:x1874190446647296:12345-0@lo:502: 00000100:00100000:2.0:1787367402.182056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:7931:x1874190446647296:12345-0@lo:502: Request processed in 635us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367402.182065:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787367402.182124:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.182395:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:7931:1874190446647296:0@lo:502: 00000020:01000000:2.0:1787367402.182435:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367402.182442:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367402.182444:0:7931:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787367402.182450:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:0.0:1787367402.182690:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787367402.182728:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e8f91db9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367402.182798:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874190446646656:12345-0@lo:8: Request processed in 2793us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.183631:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787367402.183743:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5f800 x1874190446647040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.183759:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446647040:0@lo:400: 00010000:00080000:0.0:1787367402.183775:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5df80 x1874190446647168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.183783:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446647168:0@lo:400: 00010000:00080000:0.0:1787367402.183831:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5ce00 x1874190446646912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.183841:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446646912:0@lo:400: 00000020:01000000:3.0:1787367402.184129:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787367402.184180:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787367402.184210:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.184224:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367402.184236:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787367402.184239:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e8f9231cd28 from 1 10000000:01000000:3.0:1787367402.184242:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787367402.184287:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.184296:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.184308:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367402.184328:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446647424:0@lo:101: 00010000:00080000:0.0:1787367402.184409:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5f480 x1874190446646784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.184420:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446646784:0@lo:400: 00010000:00080000:2.0:1787367402.184578:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5c700 x1874190446646656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367402.184590:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367402.184598:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787367402.184608:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787367402.184616:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787367402.184620:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3364800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787367402.184639:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787367402.184645:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446646656:0@lo:8: 00000004:00080000:2.0:1787367402.184672:0:7932:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787367402.184862:0:7932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207460657350ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787367402.188748:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.188810:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367402.188840:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647424 00000100:00100000:3.0:1787367402.188852:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647424 00000100:00100000:3.0:1787367402.188917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367402.188929:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446647424:12345-0@lo:101: 00010000:00010000:3.0:1787367402.188953:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367402.188979:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3680 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.189015:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.189029:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.189040:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f000, rc 0) 00000100:00100000:3.0:1787367402.189089:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446647424:12345-0@lo:101: Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.189096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367402.190650:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446647424:0@lo:101: 00010000:00010000:3.0:1787367402.190690:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367402.190706:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367402.190813:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446647552:0@lo:501: 00000100:00100000:3.0:1787367402.190909:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367402.190945:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90003600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367402.191057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647552 00000100:00100000:1.0:1787367402.191066:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647552 00000100:00100000:1.0:1787367402.191117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367402.191127:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446647552:12345-0@lo:501: 00000100:00100000:1.0:1787367402.191783:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446647552:12345-0@lo:501: Request processed in 656us (873us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367402.191793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367402.199085:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446647552:0@lo:501: 10000000:01000000:1.0:1787367402.199172:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787367402.199187:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367402.199218:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367402.299352:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787367402.363974:0:7933:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787367402.364021:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446647808:0@lo:7: 00000100:00100000:0.0:1787367402.365025:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.365102:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85364300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.365168:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446647680:0@lo:13: 00000100:00100000:0.0:1787367402.365230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.365339:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647808 00000100:00100000:0.0:1787367402.365348:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647808 00000100:00100000:0.0:1787367402.365421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367402.365431:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1874190446647808:12345-0@lo:7: 00000100:00100000:1.0:1787367402.370574:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647680 00000100:00100000:1.0:1787367402.370593:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647680 00000100:00100000:1.0:1787367402.371245:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367402.371262:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446647680:12345-0@lo:13: 00002000:00000024:1.0:1787367402.371319:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787367402.371453:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446647680:12345-0@lo:13: Request processed in 196us (6221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367402.371462:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787367402.371545:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c83b80 x1874190446647680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367402.371573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446647680:0@lo:13: 00000100:00080000:1.0:1787367402.374565:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787367402.379079:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787367402.379091:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787367402.379272:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7933:x1874190446647808:12345-0@lo:7: Request processed in 13835us (14244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367402.379535:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787367402.379611:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c80700 x1874190446647808/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787367418 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367402.379630:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446647808:0@lo:7: 00000004:00080000:1.0:1787367402.379649:0:7933:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787367402.379702:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446647936:0@lo:5: 00000100:00100000:1.0:1787367402.379858:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367402.379923:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90566180 going to sleep for 11 seconds 00000100:00100000:1.0:1787367402.379944:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446647936 00000100:00100000:1.0:1787367402.379962:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446647936 00000100:00100000:1.0:1787367402.380025:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367402.380036:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1874190446647936:12345-0@lo:5: 00002000:00080000:1.0:1787367402.380072:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787367402.380078:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787367402.382158:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7933:x1874190446647936:12345-0@lo:5: Request processed in 2114us (2290us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787367402.382930:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787367402.383124:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a5a680 x1874190446647936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367418 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.383158:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446647936:0@lo:5: 00000004:00080000:0.0:1787367402.383178:0:7933:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787367402.383265:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446648064:0@lo:700: 00000100:00100000:0.0:1787367402.383341:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367402.383394:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85364cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.385767:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648064 00000100:00100000:2.0:1787367402.385786:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648064 00000100:00100000:2.0:1787367402.385871:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367402.385882:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7933:x1874190446648064:12345-0@lo:700: 00000100:00100000:2.0:1787367402.385973:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1874190446648192:0@lo:700: 00000100:00100000:2.0:1787367402.386055:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367402.386097:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367402.386119:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648192 00000100:00100000:2.0:1787367402.386123:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648192 00000100:00100000:2.0:1787367402.386171:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367402.386180:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1874190446648192:12345-0@lo:700: 40000000:02000000:2.0:1787367402.442911:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787367402.456325:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6704:x1874190446648192:12345-0@lo:700: Request processed in 70134us (70257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367402.456345:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787367402.457491:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f83f5c700 x1874190446648192/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787367418 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367402.457517:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6704:1874190446648192:0@lo:700: 40000000:02000000:2.0:1787367402.457539:0:6704:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1787367402.602597:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7933:x1874190446648064:12345-0@lo:700: Request processed in 216700us (219240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367402.602618:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787367402.603128:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c80700 x1874190446648064/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787367418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.603159:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446648064:0@lo:700: 00000001:00100000:1.0:1787367402.604699:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787367402.604729:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:1.0:1787367402.655353:0:7933:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787367402.659334:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446648320:0@lo:5: 00000100:00100000:1.0:1787367402.659414:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367402.659466:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f921b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367402.659579:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648320 00000100:00100000:0.0:1787367402.659587:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648320 00000100:00100000:0.0:1787367402.659650:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787367402.659659:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7933:x1874190446648320:12345-0@lo:5: 00002000:00080000:3.0:1787367402.669720:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787367402.669742:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787367402.676799:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7933:x1874190446648320:12345-0@lo:5: Request processed in 17131us (17374us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367402.676813:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787367402.681208:0:7933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb2a5b100 x1874190446648320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.681227:0:7933:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787367402.681253:0:7933:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e8fb2a5b100 x1874190446648320/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787367418 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367402.681265:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7933:1874190446648320:0@lo:5: 00000004:00080000:0.0:1787367402.681436:0:7933:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787367403.142632:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367403.162475:0:7992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367404.165120:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367404.611564:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367404.611596:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446648448:0@lo:13: 00000100:00100000:1.0:1787367404.611695:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367404.612809:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648448 00000100:00100000:0.0:1787367404.612822:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648448 00000100:00100000:0.0:1787367404.612927:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367404.612939:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446648448:12345-0@lo:13: 00002000:00000024:0.0:1787367404.612979:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367404.613052:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446648448:12345-0@lo:13: Request processed in 116us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367404.613059:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787367404.613112:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c80700 x1874190446648448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367404.613132:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446648448:0@lo:13: 00000100:00080000:1.0:1787367404.613213:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367405.187368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367406.211796:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367407.238622:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367407.684686:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367407.684713:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446648576:0@lo:13: 00000100:00100000:0.0:1787367407.684853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367407.684923:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648576 00000100:00100000:0.0:1787367407.684930:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648576 00000100:00100000:0.0:1787367407.684992:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367407.685002:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446648576:12345-0@lo:13: 00002000:00000024:0.0:1787367407.685057:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367407.685109:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446648576:12345-0@lo:13: Request processed in 109us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367407.685117:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787367407.685138:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787367407.685165:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c80700 x1874190446648576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367407.685185:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446648576:0@lo:13: 00000100:00100000:0.0:1787367407.686826:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446648704:0@lo:400: 00000100:00100000:0.0:1787367407.686892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367407.686929:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446649216:0@lo:400: 00000100:00100000:0.0:1787367407.686964:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367407.686991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367407.686998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446649088:0@lo:400: 00000100:00100000:2.0:1787367407.687022:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446648960:0@lo:400: 00000100:00100000:0.0:1787367407.687044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367407.687073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367407.687083:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446648832:0@lo:400: 00000100:00100000:2.0:1787367407.687118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649216 00000100:00100000:0.0:1787367407.687121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367407.687125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649216 00000100:00100000:0.0:1787367407.687163:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648960 00000100:00100000:0.0:1787367407.687169:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648960 00000100:00100000:2.0:1787367407.687186:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648832 00000100:00100000:2.0:1787367407.687224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648832 00000100:00100000:0.0:1787367407.687230:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367407.687246:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446649216:12345-0@lo:400: 00000100:00100000:2.0:1787367407.687247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367407.687307:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446649216:12345-0@lo:400: Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367407.687432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446648704 00000100:00100000:1.0:1787367407.687437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446648704 00000100:00100000:1.0:1787367407.687484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367407.687493:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446648704:12345-0@lo:400: 00000100:00100000:1.0:1787367407.687529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446648704:12345-0@lo:400: Request processed in 37us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367407.687535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367407.687577:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649088 00000100:00100000:1.0:1787367407.687581:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649088 00000100:00100000:1.0:1787367407.687612:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367407.687626:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446649088:12345-0@lo:400: 00000100:00100000:1.0:1787367407.687671:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446649088:12345-0@lo:400: Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367407.687677:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367407.689082:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367407.689088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446648960:12345-0@lo:400: 00000100:00100000:0.0:1787367407.689114:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367407.689124:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446648832:12345-0@lo:400: 00000100:00100000:2.0:1787367407.689165:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446648960:12345-0@lo:400: Request processed in 85us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367407.689185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367407.689189:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446648832:12345-0@lo:400: Request processed in 65us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367407.689217:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787367407.689238:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367407.689244:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787367407.689268:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080df80 x1874190446648832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367407.689282:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446648832:0@lo:400: 00010000:00080000:0.0:1787367407.689316:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080f100 x1874190446649088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367407.689325:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446649088:0@lo:400: 00000100:00100000:0.0:1787367407.689336:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446648704:0@lo:400: 00010000:00080000:0.0:1787367407.689346:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080e680 x1874190446649216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367407.689355:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446649216:0@lo:400: 00010000:00080000:1.0:1787367407.689782:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080f480 x1874190446648960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367407.689794:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446648960:0@lo:400: 00000001:00080000:0.0:1787367407.788478:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787367408.259310:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367408.771429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367408.772595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425653376 00000100:00100000:0.0:1787367408.772610:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425653376 00000100:00100000:0.0:1787367408.772667:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:0.0:1787367408.772675:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2355:x1874190425653376:12345-192.168.204.23@tcp:250: 00010000:00080000:0.0:1787367408.772705:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7@192.168.204.23@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1787367408.773157:0:5834:0:(genops.c:1385:class_connect()) connect: client 1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7, cookie 0xcbf1f1bac53f368e 00000100:00080000:0.0:1787367408.776509:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9e8f91dba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367408.776609:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+5:2355:x1874190425653376:12345-192.168.204.23@tcp:250: Request processed in 3930us (5187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367408.776621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:0.0:1787367408.785421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367408.785508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425653504 00000100:00100000:2.0:1787367408.785518:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425653504 00000100:00100000:2.0:1787367408.785576:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1787367408.785585:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+5:5584:x1874190425653504:12345-192.168.204.23@tcp:101: 00010000:00010000:2.0:1787367408.785602:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367408.785621:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d58be expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367408.785648:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367408.785661:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367408.785670:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497800, rc 0) 00000100:00100000:2.0:1787367408.785729:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+6:5584:x1874190425653504:12345-192.168.204.23@tcp:101: Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367408.785737:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:3.0:1787367408.791144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367408.793218:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425653632 00000100:00100000:0.0:1787367408.793233:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425653632 00000100:00100000:0.0:1787367408.793357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:0.0:1787367408.793368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+6:5584:x1874190425653632:12345-192.168.204.23@tcp:501: 00000100:00100000:0.0:1787367408.793751:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+6:5584:x1874190425653632:12345-192.168.204.23@tcp:501: Request processed in 383us (2682us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787367408.793759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:0.0:1787367408.796049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.796188:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425653760 00000100:00100000:3.0:1787367408.796216:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425653760 00000100:00100000:3.0:1787367408.796267:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1787367408.796276:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+6:5584:x1874190425653760:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1787367408.796293:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367408.796309:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d58c5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.796337:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.796349:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.796359:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e600, rc 0) 00000100:00100000:3.0:1787367408.796410:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+7:5584:x1874190425653760:12345-192.168.204.23@tcp:101: Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.796431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:1.0:1787367408.802364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.802442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425653888 00000100:00100000:3.0:1787367408.802451:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425653888 00000100:00100000:3.0:1787367408.802567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1787367408.802578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+7:5584:x1874190425653888:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1787367408.802923:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5584:x1874190425653888:12345-192.168.204.23@tcp:501: Request processed in 345us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.802932:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1787367408.805320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367408.805445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654016 00000100:00100000:1.0:1787367408.805454:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654016 00000100:00100000:1.0:1787367408.805572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:1.0:1787367408.805582:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5584:x1874190425654016:12345-192.168.204.23@tcp:503: 00000100:00100000:1.0:1787367408.805946:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5584:x1874190425654016:12345-192.168.204.23@tcp:503: Request processed in 365us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367408.805955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:0.0:1787367408.810481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.810654:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654144 00000100:00100000:3.0:1787367408.810663:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654144 00000100:00100000:3.0:1787367408.810719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:3.0:1787367408.810728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5602:x1874190425654144:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1787367408.811062:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5602:x1874190425654144:12345-192.168.204.23@tcp:502: Request processed in 333us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.811070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:3.0:1787367408.846920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.846960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654272 00000100:00100000:3.0:1787367408.846969:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654272 00000100:00100000:3.0:1787367408.847025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:3.0:1787367408.847035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5602:x1874190425654272:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1787367408.847311:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5602:x1874190425654272:12345-192.168.204.23@tcp:502: Request processed in 277us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.847319:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:0.0:1787367408.857134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367408.857419:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654400 00000100:00100000:1.0:1787367408.857429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654400 00000100:00100000:1.0:1787367408.857604:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:1.0:1787367408.857615:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5584:x1874190425654400:12345-192.168.204.23@tcp:101: 00010000:00010000:1.0:1787367408.857633:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367408.857651:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5ea00/0xcbf1f1bac53f36a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d58ef expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367408.857677:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5ea00/0xcbf1f1bac53f36a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58ef expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367408.857688:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5ea00/0xcbf1f1bac53f36a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58ef expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367408.857707:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5ea00, rc 0) 00000100:00100000:1.0:1787367408.857766:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5584:x1874190425654400:12345-192.168.204.23@tcp:101: Request processed in 153us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367408.857773:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:0.0:1787367408.870028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367408.871132:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654528 00000100:00100000:2.0:1787367408.871143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654528 00000100:00100000:1.0:1787367408.871310:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:1.0:1787367408.871322:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5584:x1874190425654528:12345-192.168.204.23@tcp:256: 20000000:01000000:1.0:1787367408.871345:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787367408.871363:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787367408.871367:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787367408.871371:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787367408.871373:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787367408.875785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5584:x1874190425654528:12345-192.168.204.23@tcp:256: Request processed in 4452us (5764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367408.875800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:2.0:1787367408.881223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.881300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654656 00000100:00100000:3.0:1787367408.881318:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654656 00000100:00100000:3.0:1787367408.881371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1787367408.881381:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5584:x1874190425654656:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1787367408.881397:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367408.881415:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d58f6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.881442:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.881454:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367408.881475:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367408.881531:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5584:x1874190425654656:12345-192.168.204.23@tcp:101: Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.881538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:2.0:1787367408.883602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367408.883862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654784 00000100:00100000:0.0:1787367408.883881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654784 00000100:00100000:0.0:1787367408.883933:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:0.0:1787367408.883943:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5584:x1874190425654784:12345-192.168.204.23@tcp:501: 00000100:00100000:0.0:1787367408.884233:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5584:x1874190425654784:12345-192.168.204.23@tcp:501: Request processed in 290us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367408.884241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:3.0:1787367408.887798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367408.888003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425654912 00000100:00100000:2.0:1787367408.888024:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425654912 00000100:00100000:2.0:1787367408.888163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:2.0:1787367408.888174:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5584:x1874190425654912:12345-192.168.204.23@tcp:503: 00000100:00100000:2.0:1787367408.888581:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5584:x1874190425654912:12345-192.168.204.23@tcp:503: Request processed in 408us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367408.888598:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:2.0:1787367408.902752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367408.902830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655040 00000100:00100000:1.0:1787367408.902840:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655040 00000100:00100000:1.0:1787367408.902961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:1.0:1787367408.902971:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5604:x1874190425655040:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1787367408.903279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5604:x1874190425655040:12345-192.168.204.23@tcp:502: Request processed in 309us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367408.903287:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:2.0:1787367408.908618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.908702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655168 00000100:00100000:3.0:1787367408.908712:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655168 00000100:00100000:3.0:1787367408.908766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:3.0:1787367408.908775:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5604:x1874190425655168:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1787367408.909023:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5604:x1874190425655168:12345-192.168.204.23@tcp:502: Request processed in 248us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.909032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:0.0:1787367408.924788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367408.925177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655296 00000100:00100000:3.0:1787367408.925188:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655296 00000100:00100000:3.0:1787367408.925256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:3.0:1787367408.925272:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874190425655296:12345-192.168.204.23@tcp:38: 00010000:00080000:3.0:1787367408.925301:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1787367408.925343:0:5842:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f36b1 00000004:00100000:3.0:1787367408.925374:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787367408.925380:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787367408.953714:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367408.954133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425655296:12345-192.168.204.23@tcp:38: Request processed in 28858us (29351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367408.954146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00010000:00010000:3.0:1787367409.284042:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367409.731447:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367409.731473:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446649344:0@lo:13: 00000100:00100000:1.0:1787367409.731548:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367409.731761:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649344 00000100:00100000:0.0:1787367409.731770:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649344 00000100:00100000:0.0:1787367409.731833:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787367409.731843:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446649344:12345-0@lo:13: 00002000:00000024:0.0:1787367409.731892:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367409.731962:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446649344:12345-0@lo:13: Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367409.731970:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787367409.733522:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787367409.733727:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080f100 x1874190446649344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367409.733752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446649344:0@lo:13: 00000100:00100000:1.0:1787367409.963623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367409.963695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367409.963825:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655552 00000100:00100000:3.0:1787367409.963833:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655424 00000100:00100000:2.0:1787367409.963836:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655552 00000100:00100000:3.0:1787367409.963858:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655424 00000100:00100000:2.0:1787367409.963930:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1787367409.963946:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:5584:x1874190425655552:12345-192.168.204.23@tcp:41: 00000100:00080000:0.0:1787367409.963950:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787367409.964003:0:6718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787367409.964079:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:5584:x1874190425655552:12345-192.168.204.23@tcp:41: Request processed in 139us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367409.964087:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1787367409.964106:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1787367409.964112:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:0:x1874190425655424:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1787367409.964124:0:6718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787367409.964145:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:0:x1874190425655424:12345-192.168.204.23@tcp:41: Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367409.964154:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1787367409.974843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367409.975035:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655680 00000100:00100000:3.0:1787367409.975046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655680 00000100:00100000:3.0:1787367409.975168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367409.975180:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5584:x1874190425655680:12345-192.168.204.23@tcp:40: 00000100:00100000:3.0:1787367409.975309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5584:x1874190425655680:12345-192.168.204.23@tcp:40: Request processed in 131us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367409.975318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367409.978914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367409.979234:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655808 00000100:00100000:3.0:1787367409.979245:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655808 00000100:00100000:3.0:1787367409.979296:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1787367409.979305:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874190425655808:12345-192.168.204.23@tcp:8: 00010000:00080000:3.0:1787367409.979338:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1787367409.980241:0:6696:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f36b8 00002000:00100000:3.0:1787367409.980257:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3/ffff9e8fbb1a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367409.980284:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787367409.980725:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787367409.981216:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367409.981346:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425655808:12345-192.168.204.23@tcp:8: Request processed in 2038us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367409.981357:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1787367409.988428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367409.988474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367409.988541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367409.988548:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425655936 00000100:00100000:2.0:1787367409.988559:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425655936 00000100:00100000:3.0:1787367409.988609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656064 00000100:00100000:3.0:1787367409.988615:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656064 00000100:00100000:3.0:1787367409.988648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1787367409.988655:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5584:x1874190425656064:12345-192.168.204.23@tcp:33: 00000100:00100000:0.0:1787367409.989669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656192 00000100:00100000:0.0:1787367409.989677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656192 00000100:00100000:0.0:1787367409.989720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:0.0:1787367409.989728:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425656192:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1787367409.990105:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425656192:12345-192.168.204.23@tcp:400: Request processed in 375us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367409.990113:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:1.0:1787367409.991551:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1787367409.991560:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787367409.991563:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874190425655936:12345-192.168.204.23@tcp:8: 00000100:00100000:2.0:1787367409.991574:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1787367409.991596:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1787367409.991627:0:6695:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f36bf 00002000:00100000:1.0:1787367409.991640:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3/ffff9e8fbf5fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787367409.991664:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787367409.992477:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787367409.992515:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fa0187800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367409.992585:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425655936:12345-192.168.204.23@tcp:8: Request processed in 1022us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367409.992593:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000004:00080000:2.0:1787367410.008299:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19584us 00000004:00200000:0.0:1787367410.020831:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787367410.021387:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5584:x1874190425656064:12345-192.168.204.23@tcp:33: Request processed in 32364us (32840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367410.021404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367410.220470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367410.220607:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656320 00000100:00100000:0.0:1787367410.220618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656320 00000100:00100000:0.0:1787367410.220715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1787367410.220727:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5621:x1874190425656320:12345-192.168.204.23@tcp:101: 00010000:00010000:0.0:1787367410.220757:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367410.220788:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80030c00/0xcbf1f1bac53f36c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5920 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.220933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.220969:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.220998:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367410.221266:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787367410.221271:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367410.221367:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.221402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80030c00/0xcbf1f1bac53f36c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5920 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.221419:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5920 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367410.221427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367410.221430:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367410.221434:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f80031200, rc 0) 00000100:00100000:0.0:1787367410.221503:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:5621:x1874190425656320:12345-192.168.204.23@tcp:101: Request processed in 779us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367410.221511:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:0.0:1787367410.307678:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787367410.816468:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00010000:00010000:2.0:1787367411.331477:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367412.356678:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367412.671149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367412.679691:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656448 00000100:00100000:2.0:1787367412.679707:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656448 00000100:00100000:2.0:1787367412.679830:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1787367412.679842:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:5673:x1874190425656448:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1787367412.679901:0:6718:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1787367412.680029:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367412.680306:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:5673:x1874190425656448:12345-192.168.204.23@tcp:41: Request processed in 465us (9166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367412.680314:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1787367412.688797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367412.688904:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656576 00000100:00100000:0.0:1787367412.688924:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656576 00000100:00100000:0.0:1787367412.689014:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1787367412.689041:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:5673:x1874190425656576:12345-192.168.204.23@tcp:13: 00002000:00000024:0.0:1787367412.689093:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367412.689170:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:5673:x1874190425656576:12345-192.168.204.23@tcp:13: Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367412.689177:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00080000:2.0:1787367412.689791:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367412.696461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367412.696616:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656704 00000100:00100000:0.0:1787367412.696629:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656704 00000100:00100000:0.0:1787367412.696712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367412.696725:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5673:x1874190425656704:12345-192.168.204.23@tcp:13: 00002000:00000024:0.0:1787367412.696771:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787367412.697032:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367412.697070:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:5673:x1874190425656704:12345-192.168.204.23@tcp:13: Request processed in 349us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367412.697079:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1787367412.803534:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367412.803563:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446649472:0@lo:13: 00000100:00100000:2.0:1787367412.803643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367412.803893:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649472 00000100:00100000:0.0:1787367412.803901:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649472 00000100:00100000:0.0:1787367412.803982:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367412.804004:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446649472:12345-0@lo:13: 00002000:00000024:0.0:1787367412.804028:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367412.804076:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446649472:12345-0@lo:13: Request processed in 85us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367412.804083:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787367412.805103:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787367412.805146:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080f100 x1874190446649472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367412.805159:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787367412.805183:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446649472:0@lo:13: 00000100:00100000:3.0:1787367412.805401:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446649984:0@lo:400: 00000100:00100000:3.0:1787367412.805454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367412.805495:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367412.805501:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446649856:0@lo:400: 00000100:00100000:2.0:1787367412.805666:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649984 00000100:00100000:2.0:1787367412.805673:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649984 00000100:00100000:2.0:1787367412.805722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367412.805730:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446649984:12345-0@lo:400: 00000100:00100000:2.0:1787367412.805780:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446649984:12345-0@lo:400: Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367412.805788:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787367412.805807:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367412.806116:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446649728:0@lo:400: 00000100:00100000:1.0:1787367412.806152:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367412.806180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787367412.806186:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446649600:0@lo:400: 00000100:00100000:1.0:1787367412.806232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367412.806254:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446650112:0@lo:400: 00000100:00100000:1.0:1787367412.806291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367412.806330:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787367412.806354:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8e00 x1874190446649984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367412.806366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446649984:0@lo:400: 00000100:00100000:1.0:1787367412.806404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649600 00000100:00100000:1.0:1787367412.806408:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649600 00000100:00100000:1.0:1787367412.806437:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787367412.806444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446649600:12345-0@lo:400: 00000100:00100000:1.0:1787367412.806480:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446649600:12345-0@lo:400: Request processed in 37us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367412.806486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787367412.806638:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446649600:0@lo:400: 00000100:00100000:2.0:1787367412.806770:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649728 00000100:00100000:2.0:1787367412.806775:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649728 00000100:00100000:2.0:1787367412.806808:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650112 00000100:00100000:2.0:1787367412.806817:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650112 00000100:00100000:2.0:1787367412.806841:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446649856 00000100:00100000:2.0:1787367412.806844:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446649856 00000100:00100000:2.0:1787367412.806870:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367412.806876:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446649728:12345-0@lo:400: 00000100:00100000:2.0:1787367412.806913:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446649728:12345-0@lo:400: Request processed in 37us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367412.806918:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367412.806941:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367412.806948:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446650112:12345-0@lo:400: 00000100:00100000:2.0:1787367412.806970:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446650112:12345-0@lo:400: Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367412.806975:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367412.806984:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367412.806999:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446649856:12345-0@lo:400: 00000100:00100000:2.0:1787367412.807023:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446649856:12345-0@lo:400: Request processed in 34us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367412.807029:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787367412.807043:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367412.807060:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446650112:0@lo:400: 00000100:00100000:2.0:1787367412.807069:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446649728:0@lo:400: 00000100:00100000:1.0:1787367412.807867:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446649856:0@lo:400: 00010000:00010000:0.0:1787367413.379897:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367414.382392:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000001:00100000:0.0:1787367414.384516:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00010000:00010000:2.0:1787367414.403631:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367414.852477:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446650240:0@lo:13: 00000100:00100000:2.0:1787367414.852559:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367414.852737:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650240 00000100:00100000:0.0:1787367414.852746:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650240 00000100:00100000:0.0:1787367414.852814:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787367414.852826:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446650240:12345-0@lo:13: 00002000:00000024:0.0:1787367414.852880:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367414.852938:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446650240:12345-0@lo:13: Request processed in 116us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367414.852945:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787367414.853109:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367414.853146:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080f480 x1874190446650240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367414.853166:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446650240:0@lo:13: 00000100:00100000:1.0:1787367415.047836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367415.047881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367415.047917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367415.047949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367415.047977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656832 00000100:00100000:0.0:1787367415.047979:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657216 00000100:00100000:1.0:1787367415.047987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656832 00000100:00100000:0.0:1787367415.047987:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657216 00000100:00100000:0.0:1787367415.048025:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657088 00000100:00100000:1.0:1787367415.048030:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:1.0:1787367415.048039:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425656832:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1787367415.048039:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657088 00000100:00100000:0.0:1787367415.048061:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367415.048068:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657216:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1787367415.048149:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425656960 00000100:00100000:2.0:1787367415.048153:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425656960 00000100:00100000:2.0:1787367415.048185:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1787367415.048204:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657216:12345-192.168.204.23@tcp:400: Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367415.048214:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425656960:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1787367415.048276:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367415.048296:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1787367415.048303:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657088:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1787367415.052500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425656832:12345-192.168.204.23@tcp:400: Request processed in 4449us (4568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367415.052517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00080000:1.0:1787367415.054724:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367415.054735:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367415.054738:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367415.054875:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425656960:12345-192.168.204.23@tcp:400: Request processed in 6676us (7041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367415.054900:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1787367415.055094:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657088:12345-192.168.204.23@tcp:400: Request processed in 6790us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367415.055104:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:3.0:1787367415.427419:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367415.738794:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787367416.454496:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367417.479647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367417.923373:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446650624:0@lo:400: 00000100:00100000:0.0:1787367417.923515:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446650496:0@lo:400: 00000100:00100000:0.0:1787367417.923561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.923607:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446651008:0@lo:400: 00000100:00100000:0.0:1787367417.923677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.923720:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787367417.923727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446650368:0@lo:400: 00000100:00100000:0.0:1787367417.923755:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.923782:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446650880:0@lo:400: 00000100:00100000:0.0:1787367417.923803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.923857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650496 00000100:00100000:0.0:1787367417.923864:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650496 00000100:00100000:0.0:1787367417.923908:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650880 00000100:00100000:0.0:1787367417.923911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650880 00000100:00100000:0.0:1787367417.923941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367417.923950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446650496:12345-0@lo:400: 00000100:00100000:0.0:1787367417.924129:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446650496:12345-0@lo:400: Request processed in 180us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367417.924137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367417.924153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367417.924159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446650880:12345-0@lo:400: 00000100:00100000:0.0:1787367417.924181:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446650880:12345-0@lo:400: Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367417.924186:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367417.924227:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651008 00000100:00100000:0.0:1787367417.924231:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651008 00000100:00100000:0.0:1787367417.924259:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367417.924265:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446651008:12345-0@lo:400: 00000100:00100000:0.0:1787367417.924292:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446651008:12345-0@lo:400: Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367417.924298:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787367417.924315:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367417.924319:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367417.924346:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446650880:0@lo:400: 00000100:00100000:0.0:1787367417.924356:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446650496:0@lo:400: 00010000:00080000:0.0:1787367417.924367:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8000 x1874190446651008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367417.924388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446651008:0@lo:400: 00000100:00100000:3.0:1787367417.924536:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367417.924565:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367417.924572:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446650752:0@lo:400: 00000100:00100000:3.0:1787367417.924594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.924643:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650624 00000100:00100000:0.0:1787367417.924648:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650624 00000100:00100000:0.0:1787367417.924688:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787367417.924826:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650752 00000100:00100000:2.0:1787367417.924830:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650752 00000100:00100000:0.0:1787367417.924865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446650624:12345-0@lo:400: 00000100:00100000:0.0:1787367417.924905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446650624:12345-0@lo:400: Request processed in 212us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367417.924912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787367417.924989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446651136:0@lo:13: 00000100:00100000:0.0:1787367417.925016:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367417.925043:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446650624:0@lo:400: 00000100:00100000:0.0:1787367417.925064:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651136 00000100:00100000:0.0:1787367417.925067:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651136 00000100:00100000:1.0:1787367417.925177:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446650368 00000100:00100000:1.0:1787367417.925181:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446650368 00000100:00100000:1.0:1787367417.925234:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367417.925242:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446650368:12345-0@lo:400: 00000100:00100000:1.0:1787367417.925281:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446650368:12345-0@lo:400: Request processed in 41us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367417.925288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787367417.925528:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367417.932389:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787367417.932406:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446650752:12345-0@lo:400: 00000100:00100000:2.0:1787367417.932520:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446650752:12345-0@lo:400: Request processed in 119us (7924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367417.932528:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787367417.933785:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367417.936255:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c9f80 x1874190446650752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367417.936290:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446650752:0@lo:400: 00000100:00100000:0.0:1787367417.938116:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787367417.938132:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446651136:12345-0@lo:13: 00002000:00000024:0.0:1787367417.938173:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367417.938376:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446651136:12345-0@lo:13: Request processed in 249us (13357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367417.938383:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367417.939269:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446650368:0@lo:400: 00010000:00080000:2.0:1787367417.939384:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3900700 x1874190446651136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367417.939403:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446651136:0@lo:13: 00010000:00010000:3.0:1787367418.500364:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367419.523354:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787367419.811792:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4c477ee0 20000000:00000080:2.0:1787367419.811822:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fa0318000 uarg=0000000000000000 20000000:01000000:2.0:1787367419.812543:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787367419.812547:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787367419.812550:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787367419.812556:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787367419.812568:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787367419.812583:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787367419.812585:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787367419.812852:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787367419.812855:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787367419.815478:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787367419.821115:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787367419.821263:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787367419.821302:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787367419.821321:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787367419.821324:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787367419.828634:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787367419.829493:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787367419.829597:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787367419.829635:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787367419.829648:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787367419.829651:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787367419.834679:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787367419.837061:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787367419.837155:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787367419.837232:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787367419.837247:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787367419.837250:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787367419.840314:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787367419.840838:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787367419.840905:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787367419.840956:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1787367419.840975:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787367419.840994:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841014:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841021:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841028:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841034:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841048:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841056:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841062:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841071:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841077:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841083:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841142:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.841158:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.841182:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651264:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367419.843454:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.843471:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 9 pid: 5836 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.843485:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651392:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367419.843519:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.843527:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 18 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.843536:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651520:0@lo:104: 00000100:00100000:2.0:1787367419.843577:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.843984:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651520 00000100:00100000:0.0:1787367419.843996:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651520 00000100:00100000:0.0:1787367419.844089:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787367419.844127:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8447:x1874190446651520:12345-0@lo:104: 00010000:00010000:0.0:1787367419.844178:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.853603:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367419.853624:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8447:x1874190446651520:12345-0@lo:104: Request processed in 9519us (10041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367419.853639:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787367419.854416:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367419.854438:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854454:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367419.854459:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854470:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367419.854479:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367419.854507:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787367419.854523:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.854537:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 18 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854544:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854550:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787367419.854564:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651648:0@lo:104: 00010000:00010000:1.0:1787367419.854576:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854583:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357ea00/0xcbf1f1bac53f3680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3687 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.854610:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367419.854612:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367419.854613:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367419.854625:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367419.854638:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446651776:0@lo:103: 00000100:00100000:1.0:1787367419.854677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367419.854697:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367419.854724:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367419.854724:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651776 00000100:00100000:1.0:1787367419.854731:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651776 00010000:00010000:2.0:1787367419.854732:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 18 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.854740:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651904:0@lo:104: 00010000:00010000:2.0:1787367419.854860:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.854868:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.854877:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb397800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652032:0@lo:104: 00010000:00010000:2.0:1787367419.854905:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.854912:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.854920:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652160:0@lo:104: 00010000:00010000:2.0:1787367419.854942:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.854950:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 19 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.854971:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652288:0@lo:104: 00010000:00010000:2.0:1787367419.854998:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.855005:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.855012:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652416:0@lo:104: 00000100:00100000:2.0:1787367419.855030:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbb28eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367419.855048:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651520:0@lo:104: 00010000:00010000:1.0:1787367419.855367:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367419.855396:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787367419.855469:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787367419.855500:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.855548:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.855565:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.855581:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.855611:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.855628:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651648 00000100:00100000:0.0:1787367419.855634:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651648 00000100:00100000:0.0:1787367419.855674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446651904 00000100:00100000:0.0:1787367419.855678:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446651904 00000100:00100000:0.0:1787367419.855699:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652032 00000100:00100000:0.0:1787367419.855704:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652032 00000100:00100000:0.0:1787367419.855723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652160 00000100:00100000:0.0:1787367419.855729:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652160 00000100:00100000:1.0:1787367419.856417:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446651776:12345-0@lo:103: 00010000:00010000:1.0:1787367419.856445:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367419.856456:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.856473:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.856523:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f3687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3680 expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367419.856549:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367419.856675:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+18:3310:x1874190446651776:12345-0@lo:103: Request processed in 1267us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.856955:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652416 00000100:00100000:3.0:1787367419.856961:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652416 00000100:00100000:3.0:1787367419.856991:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367419.857000:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+7:8447:x1874190446651648:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857018:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857072:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367419.857077:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+7:8447:x1874190446651648:12345-0@lo:104: Request processed in 79us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.857084:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367419.857126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367419.857133:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+6:8447:x1874190446651904:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857141:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857177:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367419.857182:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+6:8447:x1874190446651904:12345-0@lo:104: Request processed in 50us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.857187:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367419.857218:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367419.857225:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+5:8447:x1874190446652032:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857232:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857265:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787367419.857269:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+5:8447:x1874190446652032:12345-0@lo:104: Request processed in 46us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.857275:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367419.857280:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652288 00000100:00100000:0.0:1787367419.857284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652288 00000100:00100000:3.0:1787367419.857286:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367419.857292:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+5:8447:x1874190446652160:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857305:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857308:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787367419.857314:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857321:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367419.857325:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857331:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787367419.857336:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+5:8447:x1874190446652160:12345-0@lo:104: Request processed in 45us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.857342:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787367419.857344:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367419.857350:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.857353:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:01000000:0.0:1787367419.857357:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787367419.857358:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:8447:x1874190446652416:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857364:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857387:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1787367419.857388:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.857392:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:8447:x1874190446652416:12345-0@lo:104: Request processed in 34us (1783us total) trans 0 rc 0/0 00010000:00010000:0.0:1787367419.857395:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367419.857397:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367419.857408:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787367419.857413:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.857414:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:8447:x1874190446652288:12345-0@lo:104: 00010000:00010000:3.0:1787367419.857420:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857427:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357f800/0xcbf1f1bac53f3656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f365d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857437:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787367419.857441:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857444:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1787367419.857446:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496e00 already unused, calling callback (ffffffffc1ccec20) 00000100:00100000:3.0:1787367419.857448:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:8447:x1874190446652288:12345-0@lo:104: Request processed in 36us (1869us total) trans 0 rc 0/0 10000000:00010000:0.0:1787367419.857450:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.857454:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787367419.857456:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367419.857463:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857466:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787367419.857471:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367419.857474:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367419.857482:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367419.857485:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857488:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857492:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857494:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1787367419.857499:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857500:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367419.857505:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367419.857507:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81496e00/0xcbf1f1bac53f363a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3641 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857516:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787367419.857518:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857519:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857524:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367419.857524:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80031e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367419.857527:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857533:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857533:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81496a00/0xcbf1f1bac53f362c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3633 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367419.857540:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367419.857547:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367419.857549:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367419.857551:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857556:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857557:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367419.857560:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857561:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367419.857571:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857573:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857577:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80031e00/0xcbf1f1bac53f361e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3625 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.857586:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367419.857589:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367419.857593:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367419.857611:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787367419.857626:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857632:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367419.857636:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857643:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f35ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35d1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.857653:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367419.857655:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367419.857656:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367419.857673:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446652928:0@lo:103: 00000100:00100000:3.0:1787367419.857712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367419.857744:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367419.857749:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446652800:0@lo:103: 00000100:00100000:3.0:1787367419.857769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367419.858005:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80031600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367419.858009:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.858015:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367419.858021:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367419.858026:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367419.858041:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.858047:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367419.858051:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.858057:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80031600/0xcbf1f1bac53f35f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35fb expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.858071:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367419.858079:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367419.858082:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367419.858093:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446652544:0@lo:103: 00000100:00100000:0.0:1787367419.858135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.858180:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446653056:0@lo:103: 00000100:00100000:0.0:1787367419.858257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.858285:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787367419.858297:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446652672:0@lo:103: 00000100:00100000:0.0:1787367419.858331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.858350:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446653184:0@lo:103: 00000100:00100000:0.0:1787367419.858386:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367419.858498:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446651776:0@lo:103: 00000100:00100000:3.0:1787367419.859836:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652928 00000100:00100000:3.0:1787367419.859847:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652928 00010000:00010000:3.0:1787367419.859899:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 19 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652800 00000100:00100000:2.0:1787367419.860127:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652800 00010000:00010000:2.0:1787367419.860148:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 20 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860161:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652544 00000100:00100000:2.0:1787367419.860164:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652544 00010000:00010000:2.0:1787367419.860174:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 21 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860184:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653056 00000100:00100000:2.0:1787367419.860186:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653056 00010000:00010000:2.0:1787367419.860215:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 22 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446652672 00000100:00100000:2.0:1787367419.860228:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446652672 00010000:00010000:2.0:1787367419.860239:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 23 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860262:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653184 00000100:00100000:2.0:1787367419.860265:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653184 00010000:00010000:2.0:1787367419.860276:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 24 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.860291:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367419.860298:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+24:3311:x1874190446652800:12345-0@lo:103: 00010000:00010000:2.0:1787367419.860313:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367419.860319:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 24 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860331:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 24 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860354:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367419.860433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+24:3311:x1874190446652800:12345-0@lo:103: Request processed in 135us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367419.860441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367419.860456:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367419.860462:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+23:3312:x1874190446652544:12345-0@lo:103: 00010000:00010000:2.0:1787367419.860469:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367419.860473:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 23 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860480:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 23 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860489:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367419.860536:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+23:3312:x1874190446652544:12345-0@lo:103: Request processed in 74us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367419.860542:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367419.860553:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367419.860559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+22:3312:x1874190446653056:12345-0@lo:103: 00010000:00010000:2.0:1787367419.860565:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367419.860569:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 22 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860578:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 22 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.860587:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367419.861129:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446652544:0@lo:103: 00000100:00100000:2.0:1787367419.861755:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+22:3312:x1874190446653056:12345-0@lo:103: Request processed in 1194us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367419.862428:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446653056:0@lo:103: 00000100:00100000:2.0:1787367419.862718:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367419.862753:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787367419.862845:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+21:3312:x1874190446652672:12345-0@lo:103: 00010000:00010000:2.0:1787367419.862867:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367419.862877:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 21 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.862888:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 21 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.862912:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367419.862984:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+21:3312:x1874190446652672:12345-0@lo:103: Request processed in 224us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367419.862991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787367419.863018:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787367419.863025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92392c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+20:3312:x1874190446653184:12345-0@lo:103: 00010000:00010000:2.0:1787367419.863034:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367419.863039:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 20 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.863047:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 20 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367419.863057:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367419.863060:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446652672:0@lo:103: 00000100:00100000:2.0:1787367419.863086:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92392c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+20:3312:x1874190446653184:12345-0@lo:103: Request processed in 62us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367419.863093:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787367419.863093:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446653184:0@lo:103: 00010000:00010000:2.0:1787367419.863153:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030600/0xcbf1f1bac53f365d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3656 expref: 19 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.863164:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651648:0@lo:104: 00000100:00100000:1.0:1787367419.863172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787367419.863175:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f200/0xcbf1f1bac53f3641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f363a expref: 18 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.863182:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651904:0@lo:104: 00010000:00010000:2.0:1787367419.863209:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f3633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f362c expref: 16 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.863220:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb397800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652032:0@lo:104: 00000100:00100000:2.0:1787367419.863231:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652160:0@lo:104: 00010000:00010000:2.0:1787367419.863239:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f35fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f35f4 expref: 15 pid: 5835 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.863259:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652288:0@lo:104: 00010000:00010000:2.0:1787367419.863271:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f35d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f35ca expref: 14 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.863278:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446652416:0@lo:104: 00000100:00100000:3.0:1787367419.863544:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787367419.863553:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89d46cbb-4841-4af3-a474-32a0415d3217+13:3311:x1874190446652928:12345-0@lo:103: 00010000:00010000:3.0:1787367419.863563:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367419.863568:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 13 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.863578:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 13 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.863594:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f3625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f361e expref: 13 pid: 5836 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.863679:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367419.863711:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89d46cbb-4841-4af3-a474-32a0415d3217+12:3311:x1874190446652928:12345-0@lo:103: Request processed in 161us (5997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.863718:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787367419.863891:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446652800:0@lo:103: 00000100:00100000:3.0:1787367419.865899:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446652928:0@lo:103: 00010000:00010000:3.0:1787367419.865961:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367419.867884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367419.868044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367419.868219:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651264:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367419.868245:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874190446651392:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367419.868337:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367419.873888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657472 00000100:00100000:2.0:1787367419.873906:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657472 00010000:00010000:2.0:1787367419.873962:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 10 pid: 5836 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.874135:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657344 00000100:00100000:3.0:1787367419.874140:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657344 00010000:00010000:3.0:1787367419.874160:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 11 pid: 5835 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367419.874216:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1787367419.874226:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:2356:x1874190425657472:12345-192.168.204.23@tcp:103: 00010000:00010000:3.0:1787367419.874258:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367419.874265:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 11 pid: 5836 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874277:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 11 pid: 5836 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874297:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f3695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58be expref: 11 pid: 5836 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874314:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367419.874392:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425657472:12345-192.168.204.23@tcp:103: Request processed in 168us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.874399:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1787367419.874416:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1787367419.874422:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:2356:x1874190425657344:12345-192.168.204.23@tcp:103: 00010000:00010000:3.0:1787367419.874431:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367419.874435:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874444:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874454:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f369c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58c5 expref: 9 pid: 5835 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874464:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874482:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874497:0:7633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874504:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874511:0:7633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874516:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874522:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367419.874527:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874535:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874546:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367419.874557:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367419.874577:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:2356:x1874190425657344:12345-192.168.204.23@tcp:103: Request processed in 156us (6534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.874584:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00010000:00010000:0.0:1787367419.875648:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.875693:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367419.875702:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f36d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367419.976322:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446653312:0@lo:13: 00000100:00100000:0.0:1787367419.976399:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367419.976701:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653312 00000100:00100000:3.0:1787367419.976727:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653312 00000100:00100000:3.0:1787367419.976847:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367419.976858:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446653312:12345-0@lo:13: 00002000:00000024:3.0:1787367419.976899:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367419.976954:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446653312:12345-0@lo:13: Request processed in 98us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367419.976961:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787367419.977013:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3901500 x1874190446653312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367419.977032:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446653312:0@lo:13: 00000100:00080000:0.0:1787367419.982692:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367420.163709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367420.163813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367420.163822:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657728 00000100:00100000:0.0:1787367420.163833:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657728 00000100:00100000:0.0:1787367420.163911:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367420.163921:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657728:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1787367420.163934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367420.163971:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657856 00000100:00100000:1.0:1787367420.163975:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657856 00000100:00100000:1.0:1787367420.164003:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1787367420.164009:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657856:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1787367420.164021:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657728:12345-192.168.204.23@tcp:400: Request processed in 102us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367420.164027:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1787367420.164033:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425657856:12345-192.168.204.23@tcp:400: Request processed in 25us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367420.164038:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00080000:3.0:1787367420.164224:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367420.164229:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367420.164483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657600 00000100:00100000:2.0:1787367420.164488:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657600 00000100:00080000:3.0:1787367420.164561:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367420.164561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1787367420.164569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425657600:12345-192.168.204.23@tcp:400: 00000100:00100000:2.0:1787367420.164617:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425657600:12345-192.168.204.23@tcp:400: Request processed in 49us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367420.164624:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00010000:00010000:3.0:1787367420.547959:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787367421.507574:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787367421.507585:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fbf411800 from 39 10000000:01000000:0.0:1787367421.507591:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367421.507647:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.507663:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.507678:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367421.507879:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653440:0@lo:101: 00000100:00100000:0.0:1787367421.507964:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.508032:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.508041:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653440 00000100:00100000:3.0:1787367421.508053:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653440 00000100:00100000:3.0:1787367421.508249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787367421.508260:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+12:5838:x1874190446653440:12345-0@lo:101: 00010000:00010000:3.0:1787367421.509109:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367421.509130:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f36e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f36db expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.509159:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f36e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36db expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.509171:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f36e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36db expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.509181:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e600, rc 0) 00000100:00100000:3.0:1787367421.510132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446653440:12345-0@lo:101: Request processed in 1871us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.510154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787367421.516608:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653440:0@lo:101: 00010000:00010000:0.0:1787367421.516641:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.516656:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367421.516814:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653568:0@lo:501: 00000100:00100000:0.0:1787367421.516892:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.517036:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.524414:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653568 00000100:00100000:1.0:1787367421.524431:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653568 00000100:00100000:1.0:1787367421.524542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787367421.524558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446653568:12345-0@lo:501: 00000100:00100000:1.0:1787367421.524999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446653568:12345-0@lo:501: Request processed in 447us (8106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.525009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787367421.525116:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653568:0@lo:501: 00000100:00100000:2.0:1787367421.525170:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653696:0@lo:503: 00000100:00100000:2.0:1787367421.525251:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.533363:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.533752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653696 00000100:00100000:0.0:1787367421.533775:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653696 00000100:00100000:0.0:1787367421.533953:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787367421.533965:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446653696:12345-0@lo:503: 00000100:00100000:0.0:1787367421.535294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446653696:12345-0@lo:503: Request processed in 1322us (10034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.535307:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787367421.535464:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446653696:0@lo:503: 00000100:00100000:2.0:1787367421.536476:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8465:1874190446653824:0@lo:502: 00000100:00100000:2.0:1787367421.536551:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.536826:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.538505:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653824 00000100:00100000:0.0:1787367421.538522:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653824 00000100:00100000:1.0:1787367421.538686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787367421.538702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:8465:x1874190446653824:12345-0@lo:502: 00000100:00100000:1.0:1787367421.539538:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+13:8465:x1874190446653824:12345-0@lo:502: Request processed in 836us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.539547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787367421.539750:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8465:1874190446653824:0@lo:502: 00000100:00100000:2.0:1787367421.539833:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8465:1874190446653952:0@lo:502: 00000100:00100000:2.0:1787367421.539884:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.539923:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.540719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446653952 00000100:00100000:3.0:1787367421.540727:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446653952 00000100:00100000:3.0:1787367421.540781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787367421.540791:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:8465:x1874190446653952:12345-0@lo:502: 00000100:00100000:3.0:1787367421.541616:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:8465:x1874190446653952:12345-0@lo:502: Request processed in 824us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367421.542358:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8465:1874190446653952:0@lo:502: 00000040:00080000:2.0:1787367421.542399:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787367421.542578:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787367421.542600:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787367421.542612:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.542638:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367421.542649:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787367421.542652:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787367421.542655:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787367421.542690:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.542698:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.542707:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367421.542732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787367421.542814:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654080:0@lo:101: 00000100:00100000:0.0:1787367421.542866:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.543029:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f916e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367421.543479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654080 00000100:00100000:2.0:1787367421.543486:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654080 00000100:00100000:2.0:1787367421.543527:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787367421.543536:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+13:5838:x1874190446654080:12345-0@lo:101: 00010000:00010000:2.0:1787367421.543550:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367421.543565:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f36f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f36e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.543596:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f36f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36e9 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.543606:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f36f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36e9 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.543615:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496600, rc 0) 00000100:00100000:2.0:1787367421.543673:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654080:12345-0@lo:101: Request processed in 137us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367421.543679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787367421.543841:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654080:0@lo:101: 00010000:00010000:1.0:1787367421.543857:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.543868:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367421.544480:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654208:0@lo:501: 00000100:00100000:1.0:1787367421.544518:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.544556:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.547477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654208 00000100:00100000:3.0:1787367421.547495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654208 00000100:00100000:3.0:1787367421.547580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787367421.547590:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654208:12345-0@lo:501: 00000100:00100000:3.0:1787367421.547964:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654208:12345-0@lo:501: Request processed in 375us (3445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.547972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787367421.548116:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654208:0@lo:501: 00000100:00100000:1.0:1787367421.548178:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654336:0@lo:503: 00000100:00100000:1.0:1787367421.548260:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.548327:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.549473:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654336 00000100:00100000:3.0:1787367421.549488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654336 00000100:00100000:3.0:1787367421.549558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787367421.549566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654336:12345-0@lo:503: 00000100:00100000:3.0:1787367421.549835:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654336:12345-0@lo:503: Request processed in 269us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.549842:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787367421.549908:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654336:0@lo:503: 00000100:00100000:3.0:1787367421.550093:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8466:1874190446654464:0@lo:502: 00000100:00100000:3.0:1787367421.550152:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.550174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654464 00000100:00100000:3.0:1787367421.550178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654464 00000100:00100000:3.0:1787367421.550217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787367421.550224:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:8466:x1874190446654464:12345-0@lo:502: 00000100:00100000:3.0:1787367421.550356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:8466:x1874190446654464:12345-0@lo:502: Request processed in 132us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.550363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787367421.550392:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbb28e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.550404:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8466:1874190446654464:0@lo:502: 00000020:01000000:3.0:1787367421.550426:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367421.550435:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367421.550437:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787367421.550443:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787367421.550464:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8466:1874190446654592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.550492:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.550507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654592 00000100:00100000:3.0:1787367421.550510:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654592 00000100:00100000:3.0:1787367421.550526:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787367421.550531:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:8466:x1874190446654592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.550622:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:8466:x1874190446654592:12345-0@lo:502:llog_process_th.0 Request processed in 90us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.550629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787367421.550651:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbb28e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.550661:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8466:1874190446654592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367421.550675:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367421.550683:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367421.550685:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787367421.550689:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787367421.550730:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787367421.550746:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787367421.550756:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550777:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367421.550787:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787367421.550791:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fb88be800 from 39 10000000:01000000:3.0:1787367421.550793:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367421.550816:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550824:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550833:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367421.550844:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.550866:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.550876:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84f81cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.550885:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654720 00000100:00100000:3.0:1787367421.550887:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654720 00000100:00100000:3.0:1787367421.550903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787367421.550908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:5838:x1874190446654720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367421.550923:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367421.550934:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357fe00/0xcbf1f1bac53f36fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f36f7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550953:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357fe00/0xcbf1f1bac53f36fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36f7 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550963:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357fe00/0xcbf1f1bac53f36fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f36f7 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.550972:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357fe00, rc 0) 00000100:00100000:3.0:1787367421.550995:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446654720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.551001:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787367421.551024:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367421.551034:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.551043:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367421.551076:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.551095:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.551105:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84f81cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.551114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654848 00000100:00100000:3.0:1787367421.551117:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654848 00000100:00100000:3.0:1787367421.551138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787367421.551144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446654848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.551405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446654848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.551411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787367421.551436:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.551458:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.551487:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.551511:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84f81cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.551589:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446654976 00000100:00100000:1.0:1787367421.551596:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446654976 00000100:00100000:3.0:1787367421.552097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787367421.552165:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446654976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.552366:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446654976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.552373:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787367421.552410:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446654976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.559993:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8467:1874190446655104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.560088:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367421.560282:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84f81cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.560321:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655104 00000100:00100000:0.0:1787367421.560329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655104 00000100:00100000:0.0:1787367421.560415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787367421.560424:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:8467:x1874190446655104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.560871:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8467:1874190446655104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.560960:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8467:1874190446655232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.561003:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.561034:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:8467:x1874190446655104:12345-0@lo:502:llog_process_th.0 Request processed in 611us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.561042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787367421.561646:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84f81cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.561736:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655232 00000100:00100000:0.0:1787367421.561742:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655232 00000100:00100000:0.0:1787367421.561959:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787367421.561976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:8467:x1874190446655232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.562390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+15:8467:x1874190446655232:12345-0@lo:502:llog_process_th.0 Request processed in 415us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.562398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367421.562627:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8467:1874190446655232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787367421.562660:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787367421.563008:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787367421.563030:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787367421.563042:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.563054:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367421.563070:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787367421.563073:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787367421.563076:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787367421.563110:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.563119:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.563130:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367421.563152:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.563993:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.564040:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367421.564108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655360 00000100:00100000:2.0:1787367421.564116:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655360 00000100:00100000:2.0:1787367421.564170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787367421.564230:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+15:5838:x1874190446655360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367421.564245:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367421.564260:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f370c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3705 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.564285:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f370c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3705 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.564296:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f370c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3705 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.564305:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496400, rc 0) 00000100:00100000:2.0:1787367421.564346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446655360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367421.564353:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787367421.564424:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367421.564438:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.564448:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367421.564497:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.564524:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.564558:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.564802:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655488 00000100:00100000:3.0:1787367421.564806:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655488 00000100:00100000:3.0:1787367421.564842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787367421.564850:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446655488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.565078:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446655488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.565085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787367421.565233:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.565263:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.565304:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.565326:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.565392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655616 00000100:00100000:3.0:1787367421.565396:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655616 00000100:00100000:3.0:1787367421.565422:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787367421.565428:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446655616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367421.565561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446655616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.565569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787367421.565683:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446655616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.567451:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8468:1874190446655744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.567553:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.567601:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f88f10d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.567674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655744 00000100:00100000:3.0:1787367421.567681:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655744 00000100:00100000:3.0:1787367421.568369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787367421.568382:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:8468:x1874190446655744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367421.568620:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:8468:x1874190446655744:12345-0@lo:502:llog_process_th.0 Request processed in 241us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.568629:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787367421.568745:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8468:1874190446655744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787367421.568789:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367421.568801:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367421.568803:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787367421.568807:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787367421.568833:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8468:1874190446655872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.568870:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.570598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446655872 00000100:00100000:1.0:1787367421.570609:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446655872 00000100:00100000:0.0:1787367421.570633:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f921b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.570659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787367421.570669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:8468:x1874190446655872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367421.570954:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:8468:x1874190446655872:12345-0@lo:502:llog_process_th.0 Request processed in 282us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.570962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787367421.571855:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8468:1874190446655872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787367421.571902:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367421.571911:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367421.571913:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787367421.571918:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00010000:00010000:2.0:1787367421.572046:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787367421.572187:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787367421.572240:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787367421.572250:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.572262:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367421.572272:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787367421.572275:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f92200800 from 39 10000000:01000000:1.0:1787367421.572278:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787367421.572308:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.572316:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.572325:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367421.572344:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.572407:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367421.572438:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.572507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656000 00000100:00100000:0.0:1787367421.572513:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656000 00000100:00100000:0.0:1787367421.572554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787367421.572562:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446656000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367421.572573:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367421.572589:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2174c00/0xcbf1f1bac53f371a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3713 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.572612:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2174c00/0xcbf1f1bac53f371a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3713 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.572623:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2174c00/0xcbf1f1bac53f371a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3713 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.572631:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2174c00, rc 0) 00000100:00100000:0.0:1787367421.572669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.572675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787367421.572708:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367421.572720:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.572728:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367421.572783:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.572806:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.572820:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f921b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.572830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656128 00000100:00100000:0.0:1787367421.572833:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656128 00000100:00100000:0.0:1787367421.572851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787367421.572856:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.573104:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.573118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787367421.573151:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.573178:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.573233:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.573248:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f921b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.573259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656256 00000100:00100000:0.0:1787367421.573262:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656256 00000100:00100000:0.0:1787367421.573279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787367421.573285:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.573427:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367421.573433:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.573433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787367421.573751:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8469:1874190446656384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.573797:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.573975:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.574021:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656384 00000100:00100000:3.0:1787367421.574027:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656384 00000100:00100000:1.0:1787367421.574072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787367421.574084:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:8469:x1874190446656384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367421.574389:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:8469:x1874190446656384:12345-0@lo:502:llog_process_th.0 Request processed in 307us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.574396:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787367421.574417:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8469:1874190446656384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.574465:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8469:1874190446656512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.574497:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.574524:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.574566:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656512 00000100:00100000:3.0:1787367421.574570:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656512 00000100:00100000:2.0:1787367421.574632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787367421.574642:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:8469:x1874190446656512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367421.574792:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:8469:x1874190446656512:12345-0@lo:502:llog_process_th.0 Request processed in 152us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367421.574799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367421.574846:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8469:1874190446656512:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787367421.574864:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787367421.575074:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787367421.575089:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367421.575098:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.575234:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367421.575244:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787367421.575246:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787367421.575249:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787367421.575273:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.575280:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.575287:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367421.575301:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367421.575333:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.575358:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.575433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656640 00000100:00100000:1.0:1787367421.575438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656640 00000100:00100000:1.0:1787367421.575470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787367421.575477:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446656640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367421.575486:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367421.575498:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f3728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3721 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.575519:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f3728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3721 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.575528:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f3728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3721 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367421.575537:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e400, rc 0) 00000100:00100000:1.0:1787367421.575582:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446656640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.575589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787367421.575792:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367421.575804:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367421.575812:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367421.575855:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367421.575879:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.575909:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.576046:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656768 00000100:00100000:1.0:1787367421.576051:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656768 00000100:00100000:1.0:1787367421.576078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787367421.576301:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446656768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.577121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446656768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 994us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.577132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787367421.577657:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367421.577831:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367421.577883:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.577961:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.578031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446656896 00000100:00100000:1.0:1787367421.578037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446656896 00000100:00100000:1.0:1787367421.578107:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787367421.578124:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446656896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.578355:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446656896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.578362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367421.578432:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446656896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367421.579287:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8470:1874190446657024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367421.579345:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.579385:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367421.579448:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657024 00000100:00100000:0.0:1787367421.579455:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657024 00000100:00100000:0.0:1787367421.579519:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787367421.579527:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:8470:x1874190446657024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367421.580048:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:8470:x1874190446657024:12345-0@lo:502:llog_process_th.0 Request processed in 521us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367421.580056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787367421.580309:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8470:1874190446657024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367421.580357:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367421.580370:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367421.580373:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787367421.580383:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787367421.580413:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8470:1874190446657152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367421.580459:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367421.580483:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367421.580854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657152 00000100:00100000:1.0:1787367421.580862:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657152 00000100:00100000:1.0:1787367421.580906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787367421.580915:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:8470:x1874190446657152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367421.581217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:8470:x1874190446657152:12345-0@lo:502:llog_process_th.0 Request processed in 302us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367421.581225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787367421.581551:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8470:1874190446657152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367421.581577:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367421.581583:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367421.581584:0:8470:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787367421.581588:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787367421.583534:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787367421.583570:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787367421.583581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.583594:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367421.583605:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787367421.583608:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e8f9231cd28 from 1 10000000:01000000:0.0:1787367421.583611:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787367421.583662:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.583672:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.583686:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367421.583800:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446657280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.583881:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.583980:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.584026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657280 00000100:00100000:3.0:1787367421.584035:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657280 00000100:00100000:3.0:1787367421.584227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787367421.584252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446657280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367421.584279:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367421.584302:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357ee00/0xcbf1f1bac53f3736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f372f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.584329:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357ee00/0xcbf1f1bac53f3736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f372f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.584340:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357ee00/0xcbf1f1bac53f3736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f372f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367421.584622:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ee00, rc 0) 00000100:00100000:3.0:1787367421.584688:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446657280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 438us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367421.584697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787367421.584830:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446657280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367421.584855:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.584866:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367421.584937:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446657408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367421.584972:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367421.585600:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367421.585700:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657408 00000100:00100000:3.0:1787367421.585716:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657408 00000100:00100000:1.0:1787367421.585835:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787367421.585847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446657408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367421.586642:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446657408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 795us (1666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367421.586652:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787367421.586814:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446657408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787367421.586854:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787367421.586868:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367421.586879:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367422.595370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367423.043430:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446657536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367423.043512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367423.043647:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446657664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367423.043682:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367423.043712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657536 00000100:00100000:2.0:1787367423.043719:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657536 00000100:00100000:0.0:1787367423.043744:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657664 00000100:00100000:0.0:1787367423.043748:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657664 00000100:00100000:2.0:1787367423.043776:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787367423.043782:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367423.043785:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446657536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.043787:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446657664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367423.043825:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367423.043931:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446657664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367423.043939:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787367423.043974:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446657792:0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.044004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367423.044035:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657792 00000100:00100000:0.0:1787367423.044038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657792 00000100:00100000:0.0:1787367423.044065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367423.044071:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446657792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.044119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446657792:12345-0@lo:400:kworker.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367423.044125:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787367423.044164:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446657792:0@lo:400:kworker.0 00010000:00080000:0.0:1787367423.044242:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3903800 x1874190446657664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367423.044260:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446657664:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787367423.044294:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367423.044310:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446657920:0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.044334:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367423.044361:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446657920 00000100:00100000:0.0:1787367423.044365:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446657920 00000100:00100000:0.0:1787367423.044397:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367423.044404:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446657920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.044435:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446657920:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367423.044441:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787367423.044454:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367423.044468:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446657920:0@lo:400:kworker.0 00000100:00100000:2.0:1787367423.049477:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446657536:12345-0@lo:400:kworker.0 Request processed in 5673us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367423.049495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787367423.051002:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446657536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367423.052115:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446658048:0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.052215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367423.052220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367423.052228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446658176:0@lo:400:kworker.0 00000100:00100000:0.0:1787367423.052261:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367423.052290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658176 00000100:00100000:3.0:1787367423.052296:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658176 00000100:00100000:3.0:1787367423.052367:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367423.052376:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446658176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787367423.052430:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367423.052444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446658176:12345-0@lo:400:kworker.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367423.052451:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367423.052477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446658176:0@lo:400:kworker.0 00000100:00100000:1.0:1787367423.052515:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658048 00000100:00100000:1.0:1787367423.052520:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658048 00000100:00100000:1.0:1787367423.052569:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367423.052584:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446658048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367423.052622:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446658048:12345-0@lo:400:kworker.0 Request processed in 41us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367423.052628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787367423.052676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367423.052777:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa0027b80 x1874190446658048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367423.052788:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446658048:0@lo:400:kworker.0 00010000:00010000:3.0:1787367423.621085:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367424.644518:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367424.770604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367424.770688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425657984 00000100:00100000:3.0:1787367424.770710:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425657984 00000100:00100000:3.0:1787367424.770774:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:3.0:1787367424.770784:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:5599:x1874190425657984:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1787367424.770803:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367424.770833:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f400/0xcbf1f1bac53f373d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5927 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.770864:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f400/0xcbf1f1bac53f373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5927 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.770875:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f400/0xcbf1f1bac53f373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5927 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.770885:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f400, rc 0) 00000100:00100000:3.0:1787367424.770960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425657984:12345-192.168.204.23@tcp:101: Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367424.770968:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:3.0:1787367424.779643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367424.785532:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658112 00000100:00100000:2.0:1787367424.785553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658112 00000100:00100000:3.0:1787367424.785960:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:3.0:1787367424.786063:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425658112:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1787367424.787478:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425658112:12345-192.168.204.23@tcp:501: Request processed in 1409us (7836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367424.787490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:1.0:1787367424.791828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367424.798576:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658240 00000100:00100000:0.0:1787367424.798594:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658240 00000100:00100000:0.0:1787367424.798668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1787367424.798681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425658240:12345-192.168.204.23@tcp:503: 00000100:00100000:0.0:1787367424.801384:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425658240:12345-192.168.204.23@tcp:503: Request processed in 2692us (9564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367424.801398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:1.0:1787367424.810735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367424.811504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658368 00000100:00100000:3.0:1787367424.811518:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658368 00000100:00100000:3.0:1787367424.811584:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:3.0:1787367424.811594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:6086:x1874190425658368:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1787367424.814818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:6086:x1874190425658368:12345-192.168.204.23@tcp:502: Request processed in 3209us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367424.814847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:3.0:1787367424.822268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367424.822800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658496 00000100:00100000:0.0:1787367424.822814:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658496 00000100:00100000:0.0:1787367424.822909:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:0.0:1787367424.822921:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:6086:x1874190425658496:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367424.823371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:6086:x1874190425658496:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 451us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367424.823381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:1.0:1787367424.831294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367424.831465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658624 00000100:00100000:3.0:1787367424.831480:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658624 00000100:00100000:3.0:1787367424.831648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:3.0:1787367424.831663:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425658624:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367424.831710:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367424.831743:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357fa00/0xcbf1f1bac53f3744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d592e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.831801:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357fa00/0xcbf1f1bac53f3744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d592e expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.831816:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357fa00/0xcbf1f1bac53f3744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d592e expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367424.831829:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357fa00, rc 0) 00000100:00100000:3.0:1787367424.832580:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425658624:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 918us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367424.832589:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:2.0:1787367424.847337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367424.847468:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658752 00000100:00100000:1.0:1787367424.847481:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658752 00000100:00100000:1.0:1787367424.847543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:1.0:1787367424.847554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425658752:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367424.850785:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425658752:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 3218us (3451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367424.850814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:2.0:1787367425.102224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446658304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367425.102350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367425.102565:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658304 00000100:00100000:0.0:1787367425.102573:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658304 00000100:00100000:0.0:1787367425.102648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367425.102658:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446658304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367425.102705:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367425.102765:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446658304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367425.102773:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787367425.102852:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787367425.102925:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3900000 x1874190446658304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367425.102949:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446658304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367425.285533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367425.285592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367425.285635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367425.285674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367425.285726:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659264 00000100:00100000:2.0:1787367425.285737:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659264 00000100:00100000:1.0:1787367425.285738:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659136 00000100:00100000:1.0:1787367425.285745:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659136 00000100:00100000:3.0:1787367425.285819:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425658880 00000100:00100000:3.0:1787367425.285824:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425658880 00000100:00100000:3.0:1787367425.285903:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:3.0:1787367425.285914:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2359:x1874190425658880:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367425.286001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2359:x1874190425658880:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367425.286252:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659008 00000100:00100000:0.0:1787367425.286256:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659008 00000100:00100000:2.0:1787367425.286363:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1787367425.286372:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425659264:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367425.286406:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425659264:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 37us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367425.286414:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1787367425.286479:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:1.0:1787367425.291415:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:1.0:1787367425.291430:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425659136:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367425.291518:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425659136:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 93us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367425.291526:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1787367425.298850:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1787367425.298876:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425659008:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367425.298993:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425659008:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 130us (13478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367425.299000:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00080000:2.0:1787367425.300857:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367425.300873:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367425.300876:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787367425.667647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787367426.525686:0:8510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf7de5800 20000000:00000080:3.0:1787367426.525705:0:8510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8f908b9c00 uarg=0000000000000000 20000000:01000000:3.0:1787367426.525740:0:8510:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787367426.525746:0:8510:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787367426.525751:0:8510:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787367426.527086:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787367426.527427:0:8510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787367426.534062:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787367426.534115:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787367426.534173:0:8510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787367426.534225:0:8510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787367426.534244:0:8510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534340:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534348:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534353:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534362:0:8510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534369:0:8510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534414:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534429:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367426.534445:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0026d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658432:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367426.534643:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534652:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367426.534684:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658560:0@lo:104: 00000100:00100000:1.0:1787367426.534736:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787367426.534776:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.534785:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367426.534794:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658688:0@lo:104: 00000100:00100000:1.0:1787367426.534820:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367426.534855:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787367426.534868:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658560 00000100:00100000:1.0:1787367426.534877:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658560 00000100:00100000:1.0:1787367426.534919:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658688 00000100:00100000:1.0:1787367426.534922:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658688 00000100:00100000:1.0:1787367426.534939:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367426.534950:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:8510:x1874190446658560:12345-0@lo:104: 00010000:00010000:1.0:1787367426.534965:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535016:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367426.535023:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:8510:x1874190446658560:12345-0@lo:104: Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367426.535031:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787367426.535048:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367426.535054:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8510:x1874190446658688:12345-0@lo:104: 00010000:00010000:1.0:1787367426.535061:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535105:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787367426.535110:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8510:x1874190446658688:12345-0@lo:104: Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367426.535116:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787367426.535157:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367426.535164:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535172:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80031400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367426.535176:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535185:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367426.535214:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367426.535220:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367426.535821:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535832:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367426.535865:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535874:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80031400/0xcbf1f1bac53f35e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f35ed expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535905:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367426.535909:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535916:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2174600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367426.535920:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535927:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367426.535934:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367426.535940:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367426.535962:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535968:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367426.535974:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535981:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174600/0xcbf1f1bac53f351b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3522 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.535992:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367426.535994:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367426.535996:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367426.536023:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446658816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367426.536079:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367426.536115:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367426.536122:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446658944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367426.536162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367426.536237:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658816 00000100:00100000:1.0:1787367426.536244:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658816 00010000:00010000:1.0:1787367426.536503:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367426.537364:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446658944 00000100:00100000:1.0:1787367426.537372:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446658944 00010000:00010000:1.0:1787367426.537394:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.537986:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367426.538610:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367426.538637:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+20:3310:x1874190446658816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367426.538656:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367426.538673:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.538688:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.538714:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367426.538992:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446658816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367426.539055:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+20:3310:x1874190446658816:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367426.539065:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367426.539091:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367426.539098:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446658944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367426.539109:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367426.539121:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.539130:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.539140:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367426.539183:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446658944:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367426.539189:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367426.539368:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446658944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367426.539801:0:8510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.539826:0:8510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367426.539839:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446659072:0@lo:104: 00000100:00100000:0.0:1787367426.539888:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367426.539916:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f94daaf00 going to sleep for 11 seconds 00010000:00010000:0.0:1787367426.539932:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030e00/0xcbf1f1bac53f35ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f35e6 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367426.539948:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658560:0@lo:104: 00010000:00010000:0.0:1787367426.539958:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030400/0xcbf1f1bac53f3522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f351b expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367426.539966:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658688:0@lo:104: 00000100:00100000:1.0:1787367426.540964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659072 00000100:00100000:1.0:1787367426.540977:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659072 00000100:00100000:1.0:1787367426.541027:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367426.541036:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8510:x1874190446659072:12345-0@lo:104: 00010000:00010000:1.0:1787367426.541051:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.541143:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367426.541150:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+3:8510:x1874190446659072:12345-0@lo:104: Request processed in 117us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367426.541157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787367426.541462:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3901500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446659072:0@lo:104: 00010000:00010000:3.0:1787367426.541551:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367426.541559:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.541568:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367426.541573:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.541583:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367426.541607:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367426.541614:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367426.541785:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.541793:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367426.541836:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.541844:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175200/0xcbf1f1bac53f34b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f34c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.541861:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367426.541863:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367426.541865:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367426.541900:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367426.541913:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446659200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367426.541961:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367426.542092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659200 00000100:00100000:3.0:1787367426.542098:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659200 00010000:00010000:3.0:1787367426.542128:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367426.542163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367426.542172:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+17:3313:x1874190446659200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367426.542186:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367426.542227:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.542238:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.542839:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f34c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f34b9 expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367426.542857:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367426.542914:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+16:3313:x1874190446659200:12345-0@lo:103:ldlm_bl.0 Request processed in 743us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367426.542922:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367426.543066:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446659200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367426.543537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367426.543602:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659392 00000100:00100000:1.0:1787367426.543608:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659392 00010000:00010000:1.0:1787367426.543705:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367426.543761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1787367426.543771:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425659392:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367426.543786:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367426.543792:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543813:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543831:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543839:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543856:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543864:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543871:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543878:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543884:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367426.543889:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543904:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543915:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367426.543928:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367426.544109:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425659392:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 338us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367426.544117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:2.0:1787367426.544186:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f36aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d58f6 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367426.544236:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0026d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8510:1874190446658432:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367426.544367:0:8510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367426.544377:0:8510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367426.544383:0:8510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367426.544390:0:8510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5fe00/0xcbf1f1bac53f374b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367426.697733:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367427.726017:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787367427.907268:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367427.907278:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbf411800 from 4 10000000:01000000:1.0:1787367427.907284:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367427.907338:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.907353:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.907367:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367427.907396:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367427.907489:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367427.907682:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367427.907846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659328 00000100:00100000:0.0:1787367427.907857:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659328 00000100:00100000:0.0:1787367427.907924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787367427.907935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446659328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367427.907952:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367427.907969:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3752 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367427.908000:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367427.908015:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367427.908027:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2175200, rc 0) 00000100:00100000:0.0:1787367427.908085:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367427.908094:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787367427.908157:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367427.908176:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367427.908184:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367427.908307:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3903b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367427.908342:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367427.908360:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367427.908376:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659456 00000100:00100000:0.0:1787367427.908380:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659456 00000100:00100000:0.0:1787367427.908406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787367427.908413:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367427.910996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2571us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367427.911016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787367427.911315:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3903b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367427.911370:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367427.911422:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367427.911468:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0160a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367427.911546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659584 00000100:00100000:3.0:1787367427.911553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659584 00000100:00100000:3.0:1787367427.911589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787367427.911598:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367427.911928:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367427.911936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787367427.912142:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367427.912738:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8562:1874190446659712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367427.912799:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367427.912833:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367427.912924:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659712 00000100:00100000:1.0:1787367427.912929:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659712 00000100:00100000:1.0:1787367427.912969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787367427.912977:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:8562:x1874190446659712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.913180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:8562:x1874190446659712:12345-0@lo:502:llog_process_th.0 Request processed in 203us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367427.913187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787367427.916571:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8562:1874190446659712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367427.916625:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367427.916645:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367427.916647:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787367427.916654:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fbf411800 00000020:00000080:2.0:1787367427.916656:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367427.916756:0:8562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8562:1874190446659840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367427.916977:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.917030:0:8562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367427.917095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659840 00000100:00100000:1.0:1787367427.917102:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659840 00000100:00100000:1.0:1787367427.917169:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787367427.917179:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:8562:x1874190446659840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.917471:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:8562:x1874190446659840:12345-0@lo:502:llog_process_th.0 Request processed in 293us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367427.917480:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787367427.918224:0:8562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8562:1874190446659840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367427.918264:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367427.918272:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367427.918274:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787367427.918279:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787367427.918457:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787367427.918488:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367427.918508:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.918520:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367427.918532:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367427.918535:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fb88be800 from 4 10000000:01000000:1.0:1787367427.918538:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367427.918569:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.918590:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.918602:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367427.918633:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367427.918695:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367427.918741:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f901ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.918906:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446659968 00000100:00100000:2.0:1787367427.918912:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446659968 00000100:00100000:2.0:1787367427.918953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787367427.918962:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446659968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367427.918975:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367427.918990:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3760 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.919019:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.919030:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.919040:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496a00, rc 0) 00000100:00100000:2.0:1787367427.919092:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446659968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.919099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787367427.919143:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446659968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367427.919158:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.919167:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367427.919267:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.919295:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.919316:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.919331:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660096 00000100:00100000:2.0:1787367427.919335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660096 00000100:00100000:2.0:1787367427.919359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787367427.919365:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446660096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.919657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446660096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.919664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787367427.919695:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.919727:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.919767:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.919911:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.919927:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660224 00000100:00100000:2.0:1787367427.919931:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660224 00000100:00100000:2.0:1787367427.919954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787367427.919960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446660224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.920112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446660224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.920119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787367427.920157:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.920406:0:8563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8563:1874190446660352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367427.920446:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.920465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660352 00000100:00100000:2.0:1787367427.920468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660352 00000100:00100000:2.0:1787367427.920488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787367427.920494:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:8563:x1874190446660352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367427.921006:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:8563:x1874190446660352:12345-0@lo:502:llog_process_th.0 Request processed in 510us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.921014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787367427.921056:0:8563:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878a9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.921070:0:8563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8563:1874190446660352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367427.921092:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367427.921103:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367427.921105:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787367427.921111:0:8563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fb88be800 00000020:00000080:2.0:1787367427.921113:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367427.921176:0:8563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8563:1874190446660480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.927412:0:8563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367427.927462:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660480 00000100:00100000:1.0:1787367427.927470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660480 00000100:00100000:1.0:1787367427.927533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787367427.927543:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:8563:x1874190446660480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.927898:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:8563:x1874190446660480:12345-0@lo:502:llog_process_th.0 Request processed in 356us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367427.927906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787367427.927959:0:8563:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367427.927982:0:8563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8563:1874190446660480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367427.928031:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367427.928110:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367427.928113:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787367427.928119:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787367427.928322:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787367427.928341:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367427.928351:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928363:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367427.928373:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787367427.928376:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92200800 from 4 10000000:01000000:2.0:1787367427.928379:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367427.928410:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928425:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928435:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367427.928457:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.928494:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.928535:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.928552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660608 00000100:00100000:2.0:1787367427.928556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660608 00000100:00100000:2.0:1787367427.928582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787367427.928590:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446660608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367427.928600:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367427.928614:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f376e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928647:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928659:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928668:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496e00, rc 0) 00000100:00100000:2.0:1787367427.928698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446660608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.928705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787367427.928745:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367427.928759:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367427.928768:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367427.928943:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.928968:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.928984:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.928996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660736 00000100:00100000:2.0:1787367427.929000:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660736 00000100:00100000:2.0:1787367427.929017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787367427.929022:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446660736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.929329:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446660736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.929336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787367427.929367:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.929393:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.929429:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367427.929448:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.929460:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660864 00000100:00100000:2.0:1787367427.929463:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660864 00000100:00100000:2.0:1787367427.929481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787367427.929486:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446660864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367427.931445:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446660864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1950us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.931465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787367427.937759:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446660864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367427.938159:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8567:1874190446660992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.938270:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367427.938312:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446660992 00000100:00100000:1.0:1787367427.938318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446660992 00000100:00100000:1.0:1787367427.938368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787367427.938378:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:8567:x1874190446660992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.938655:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:8567:x1874190446660992:12345-0@lo:502:llog_process_th.0 Request processed in 277us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367427.938664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787367427.938723:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f901eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367427.938740:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8567:1874190446660992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367427.938767:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367427.938777:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367427.938779:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787367427.938788:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f92200800 00000020:00000080:1.0:1787367427.938790:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787367427.939279:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8567:1874190446661120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367427.939326:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367427.939355:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f901eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367427.940011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661120 00000100:00100000:2.0:1787367427.940021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661120 00000100:00100000:2.0:1787367427.940169:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787367427.940180:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:8567:x1874190446661120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367427.940658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:8567:x1874190446661120:12345-0@lo:502:llog_process_th.0 Request processed in 480us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367427.940667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787367427.942820:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:8567:1874190446661120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367427.942872:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367427.942881:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367427.942883:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787367427.942888:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787367427.942954:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787367427.942972:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367427.942983:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367427.943006:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367428.163802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446661376:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.163876:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.163932:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367428.163938:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446661504:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.163966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.164006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661376 00000100:00100000:3.0:1787367428.164013:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661376 00000100:00100000:0.0:1787367428.164033:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446661248:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.164063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367428.164063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.164072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446661376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367428.164079:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446661760:0@lo:400:kworker.0 00000100:00100000:0.0:1787367428.164097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.164118:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446661376:12345-0@lo:400:kworker.0 Request processed in 47us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367428.164119:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367428.164124:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446661632:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.164133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367428.164141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.164148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661248 00000100:00100000:3.0:1787367428.164151:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661248 00000100:00100000:3.0:1787367428.164163:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661632 00000100:00100000:3.0:1787367428.164166:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661632 00000100:00100000:3.0:1787367428.164181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787367428.164187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446661248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367428.164203:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787367428.164212:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.164241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446661248:12345-0@lo:400:kworker.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367428.164246:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446661632:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.164247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787367428.164253:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787367428.164264:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661504 00000100:00100000:3.0:1787367428.164267:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661504 00000100:00100000:0.0:1787367428.164268:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661760 00000100:00100000:0.0:1787367428.164270:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661760 00000100:00100000:3.0:1787367428.164356:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367428.164363:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446661504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.164394:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446661504:12345-0@lo:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.164400:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367428.164411:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367428.164418:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.164444:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446661760:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.164450:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787367428.166665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367428.166675:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367428.166678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367428.166699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367428.166722:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446661888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367428.166867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367428.166994:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446661632:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.167006:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446661248:0@lo:400:kworker.0 00010000:00080000:3.0:1787367428.167019:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1cb800 x1874190446661760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367428.167029:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446661760:0@lo:400:kworker.0 00010000:00080000:3.0:1787367428.167064:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c9f80 x1874190446661504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367428.167073:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446661504:0@lo:400:kworker.0 00000100:00100000:3.0:1787367428.167085:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446661376:0@lo:400:kworker.0 00000100:00100000:0.0:1787367428.167160:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446661888 00000100:00100000:0.0:1787367428.167167:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446661888 00000100:00100000:3.0:1787367428.167508:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787367428.167519:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446661888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367428.167561:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367428.167669:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446661888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.167676:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787367428.167723:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3902300 x1874190446661888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367428.167739:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446661888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367428.555177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367428.555343:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659520 00000100:00100000:3.0:1787367428.555357:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659520 00000100:00100000:3.0:1787367428.555436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:3.0:1787367428.555447:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:5599:x1874190425659520:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367428.555587:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367428.555610:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5935 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367428.555682:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367428.555698:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367428.555710:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f600, rc 0) 00000100:00100000:3.0:1787367428.555843:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425659520:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 397us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.555851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:0.0:1787367428.568595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367428.575872:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659648 00000100:00100000:3.0:1787367428.575897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659648 00000100:00100000:3.0:1787367428.575998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:3.0:1787367428.576011:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425659648:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367428.576394:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425659648:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 385us (7812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.576403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1787367428.590173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367428.590328:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659776 00000100:00100000:3.0:1787367428.590339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659776 00000100:00100000:3.0:1787367428.590402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:3.0:1787367428.590413:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425659776:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367428.590688:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:5599:x1874190425659776:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 275us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367428.590696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:1.0:1787367428.609173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367428.609233:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425659904 00000100:00100000:1.0:1787367428.609245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425659904 00000100:00100000:1.0:1787367428.609305:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:1.0:1787367428.609317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:6150:x1874190425659904:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367428.609599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:6150:x1874190425659904:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 283us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367428.609607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:1.0:1787367428.621654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367428.621761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660032 00000100:00100000:0.0:1787367428.621777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660032 00000100:00100000:0.0:1787367428.621891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:0.0:1787367428.621904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:6150:x1874190425660032:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367428.623768:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:6150:x1874190425660032:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 1851us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367428.623786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 192 00010000:00010000:0.0:1787367428.756580:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367429.763467:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367430.211990:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367430.212025:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446662016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367430.212134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367430.212371:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662016 00000100:00100000:2.0:1787367430.212381:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662016 00000100:00100000:2.0:1787367430.212460:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787367430.212470:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446662016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367430.212516:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367430.212576:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446662016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367430.212584:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787367430.212801:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787367430.212835:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3902300 x1874190446662016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367430.212856:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446662016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367430.404345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367430.404387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367430.404431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367430.404450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367430.404485:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660544 00000100:00100000:0.0:1787367430.404495:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660544 00000100:00100000:0.0:1787367430.404587:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660416 00000100:00100000:0.0:1787367430.404606:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660416 00000100:00100000:0.0:1787367430.404634:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1787367430.404645:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425660544:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367430.404846:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1787367430.404856:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425660416:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367430.404977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660288 00000100:00100000:3.0:1787367430.404990:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660288 00000100:00100000:0.0:1787367430.405045:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425660544:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 401us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367430.405054:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:1.0:1787367430.405119:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660160 00000100:00100000:1.0:1787367430.405124:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660160 00000100:00100000:1.0:1787367430.405154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:1.0:1787367430.405161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2359:x1874190425660160:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367430.408566:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425660416:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 3699us (4101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367430.408585:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00080000:3.0:1787367430.409373:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367430.409382:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367430.409385:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367430.409417:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1787367430.409439:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425660288:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367430.409525:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425660288:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 97us (5197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367430.409532:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367430.409832:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2359:x1874190425660160:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 4669us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367430.409854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 193 00010000:00010000:3.0:1787367430.787447:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367431.818388:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367432.839309:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367433.287796:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446662144:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.287888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.288131:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446662656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.288229:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787367433.288237:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446662272:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288260:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.288279:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446662784:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.288345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662144 00000100:00100000:2.0:1787367433.288351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662144 00000100:00100000:2.0:1787367433.288402:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787367433.288411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446662144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446662144:12345-0@lo:400:kworker.0 Request processed in 54us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.288472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787367433.288507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662656 00000100:00100000:2.0:1787367433.288511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662656 00000100:00100000:2.0:1787367433.288562:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662272 00000100:00100000:2.0:1787367433.288566:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662272 00000100:00100000:2.0:1787367433.288586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787367433.288592:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446662656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446662656:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.288629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787367433.288642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787367433.288648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446662272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.288940:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446662272:12345-0@lo:400:kworker.0 Request processed in 291us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367433.289094:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446662400:0@lo:400:kworker.0 00000100:00100000:1.0:1787367433.289130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367433.289147:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367433.289153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446662528:0@lo:400:kworker.0 00000100:00100000:1.0:1787367433.289175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.289281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787367433.289296:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662400 00000100:00100000:2.0:1787367433.289299:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662400 00000100:00100000:2.0:1787367433.289320:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787367433.289326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.289370:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446662400:12345-0@lo:400:kworker.0 Request processed in 44us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.289378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787367433.289400:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662784 00000100:00100000:2.0:1787367433.289404:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662784 00000100:00100000:2.0:1787367433.289432:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662528 00000100:00100000:2.0:1787367433.289435:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662528 00000100:00100000:2.0:1787367433.289454:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787367433.289461:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446662784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.289491:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446662784:12345-0@lo:400:kworker.0 Request processed in 31us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.289498:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787367433.289508:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787367433.289515:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446662528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.289552:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446662528:12345-0@lo:400:kworker.0 Request processed in 38us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.289557:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787367433.289576:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367433.289579:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367433.289582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367433.289624:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446662272:0@lo:400:kworker.0 00010000:00080000:2.0:1787367433.289637:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a1f80 x1874190446662784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367433.289655:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446662784:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.289666:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446662144:0@lo:400:kworker.0 00000100:00100000:0.0:1787367433.290368:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367433.290396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446662912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367433.290481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367433.291688:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446662656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367433.291802:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446662912 00000100:00100000:2.0:1787367433.291808:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446662912 00000100:00100000:2.0:1787367433.291872:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787367433.291880:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446662912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367433.291919:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367433.292059:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446662912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367433.292066:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787367433.292100:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3902680 x1874190446662912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367433.292116:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446662912:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787367433.292315:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a1880 x1874190446662528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367433.292326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446662528:0@lo:400:kworker.0 00000100:00100000:1.0:1787367433.292337:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446662400:0@lo:400:kworker.0 00010000:00010000:3.0:1787367433.861997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367434.386068:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787367434.889590:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367435.331444:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367435.331469:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446663040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367435.331561:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367435.331661:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663040 00000100:00100000:0.0:1787367435.331669:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663040 00000100:00100000:0.0:1787367435.331733:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787367435.331744:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446663040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367435.331790:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367435.331838:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446663040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367435.331846:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787367435.332001:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367435.332032:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3902680 x1874190446663040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367435.332053:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446663040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367435.536426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367435.536483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367435.536524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367435.536550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367435.536593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660800 00000100:00100000:2.0:1787367435.536604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660800 00000100:00100000:2.0:1787367435.536666:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1787367435.536678:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425660800:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367435.536775:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425660800:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 99us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367435.536800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1787367435.536826:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660928 00000100:00100000:2.0:1787367435.536830:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660928 00000100:00100000:2.0:1787367435.536855:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661056 00000100:00100000:2.0:1787367435.536858:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661056 00000100:00100000:2.0:1787367435.536879:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367435.536886:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2355:x1874190425660928:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:2.0:1787367435.536914:0:8211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f36b8 00000100:00080000:2.0:1787367435.536924:0:8211:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367435.536964:0:8211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787367435.537414:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+2:2355:x1874190425660928:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 527us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367435.537422:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367435.537436:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:2.0:1787367435.537443:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2355:x1874190425661056:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:2.0:1787367435.537457:0:8211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f36bf 00000100:00080000:2.0:1787367435.537463:0:8211:0:(import.c:65:import_set_state_nolock()) ffff9e8fa0187800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367435.537482:0:8211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787367435.537683:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+2:2355:x1874190425661056:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 239us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367435.537690:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1787367435.538003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425660672 00000100:00100000:1.0:1787367435.538009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425660672 00000100:00100000:1.0:1787367435.538054:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:1.0:1787367435.538062:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425660672:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367435.538091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425660672:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 31us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367435.538098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 195 00010000:00010000:1.0:1787367435.538125:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787367435.542821:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367435.542831:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367435.542836:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367435.542848:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367435.907445:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367436.448863:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:2.0:1787367436.448871:0:6722:0:(genops.c:885:class_export_put()) final put ffff9e8fbb1a0800/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:3.0:1787367436.448965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbb1a0800/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-OST0000 00000020:00000080:3.0:1787367436.449103:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbb1a7000 for lustre-OST0000 00010000:00010000:3.0:1787367436.931852:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367437.955382:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367438.403517:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446663168:0@lo:400:kworker.0 00000100:00100000:1.0:1787367438.403615:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367438.403705:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367438.403711:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446663296:0@lo:400:kworker.0 00000100:00100000:1.0:1787367438.403742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367438.403782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663168 00000100:00100000:1.0:1787367438.403789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663168 00000100:00100000:1.0:1787367438.403842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787367438.403851:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446663168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367438.403899:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446663168:12345-0@lo:400:kworker.0 Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367438.403906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787367438.403938:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663296 00000100:00100000:1.0:1787367438.403942:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663296 00000100:00100000:1.0:1787367438.403966:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367438.403972:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446663296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367438.404000:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446663296:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367438.404005:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787367438.404043:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446663296:0@lo:400:kworker.0 00000100:00100000:1.0:1787367438.404052:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446663168:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404155:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446663808:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367438.404240:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367438.404247:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446663680:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404271:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367438.404297:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446663424:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367438.404339:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367438.404344:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446663552:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404365:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367438.404392:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663808 00000100:00100000:3.0:1787367438.404396:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663808 00000100:00100000:3.0:1787367438.404563:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663552 00000100:00100000:3.0:1787367438.404567:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663552 00000100:00100000:3.0:1787367438.404587:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367438.404594:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446663808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404633:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446663808:12345-0@lo:400:kworker.0 Request processed in 40us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367438.404640:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367438.404653:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367438.404659:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446663552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404689:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446663552:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367438.404694:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367438.404712:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663680 00000100:00100000:3.0:1787367438.404716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663680 00000100:00100000:3.0:1787367438.404737:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663424 00000100:00100000:3.0:1787367438.404740:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663424 00000100:00100000:3.0:1787367438.404759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367438.404765:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446663680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404800:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446663680:12345-0@lo:400:kworker.0 Request processed in 35us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367438.404806:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367438.404816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787367438.404821:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446663424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446663424:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367438.404849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787367438.404890:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8a80 x1874190446663552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367438.404901:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446663552:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404910:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446663424:0@lo:400:kworker.0 00000100:00100000:3.0:1787367438.404932:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446663680:0@lo:400:kworker.0 00010000:00080000:3.0:1787367438.404940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c9f80 x1874190446663808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367438.404948:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446663808:0@lo:400:kworker.0 00000100:00080000:1.0:1787367438.405009:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367438.405014:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367438.405017:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367438.405343:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367438.405352:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446663936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367438.405385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367438.405496:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446663936 00000100:00100000:1.0:1787367438.405501:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446663936 00000100:00100000:1.0:1787367438.405542:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367438.405548:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446663936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367438.405587:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367438.405633:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446663936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367438.405639:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787367438.405672:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a1880 x1874190446663936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367438.405687:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446663936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787367438.979355:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367439.194302:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing yml_node 00010000:00010000:2.0:1787367440.005296:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367440.040952:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:2.0:1787367440.040967:0:7644:0:(genops.c:885:class_export_put()) final put ffff9e8fbf5fb000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:3.0:1787367440.041067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf5fb000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-OST0001 00000020:00000080:3.0:1787367440.043517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fa0187800 for lustre-OST0001 00000100:00100000:3.0:1787367440.452653:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367440.452694:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446664064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367440.452820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367440.453039:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664064 00000100:00100000:2.0:1787367440.453052:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664064 00000100:00100000:2.0:1787367440.453152:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787367440.453166:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446664064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367440.453267:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367440.453333:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446664064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367440.453341:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787367440.453427:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367440.453471:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb395f80 x1874190446664064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367440.453518:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446664064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367440.645786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367440.646397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367440.646776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661312 00000100:00100000:2.0:1787367440.646779:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661184 00000100:00100000:2.0:1787367440.646791:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661184 00000100:00100000:0.0:1787367440.646791:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661312 00000100:00100000:2.0:1787367440.646870:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:0.0:1787367440.646871:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1787367440.646892:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425661184:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367440.646892:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425661312:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367440.647001:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425661312:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 120us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367440.647031:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1787367440.647358:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425661184:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 477us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367440.647366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00080000:3.0:1787367440.648118:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367441.027639:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367442.057638:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367443.075371:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367443.453793:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.45 00000100:00100000:1.0:1787367443.523530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367443.523574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446664192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367443.523672:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367443.525619:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446664320:0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.525648:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446664448:0@lo:400:kworker.0 00000100:00100000:0.0:1787367443.525850:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664192 00000100:00100000:0.0:1787367443.525867:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664192 00000100:00100000:2.0:1787367443.525959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367443.526023:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367443.526031:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446664576:0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.526059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367443.526135:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367443.526159:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446664192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367443.526175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1787367443.526325:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367443.526433:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446664192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367443.526443:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367443.526530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664448 00000100:00100000:2.0:1787367443.526541:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664448 00000100:00080000:0.0:1787367443.526558:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367443.526615:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664576 00000100:00100000:2.0:1787367443.526621:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664576 00000100:00100000:0.0:1787367443.526635:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787367443.526649:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446664448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.526682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367443.526696:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446664576:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787367443.527012:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a1880 x1874190446664192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367443.527123:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446664192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367443.527151:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446664832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367443.529386:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446664704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367443.529601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367443.529631:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446664576:12345-0@lo:400:kworker.0 Request processed in 2930us (3563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367443.529631:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367443.529651:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367443.529713:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664704 00000100:00100000:3.0:1787367443.529729:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664704 00000100:00100000:1.0:1787367443.529745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664320 00000100:00100000:1.0:1787367443.529758:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664320 00000100:00100000:3.0:1787367443.529821:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787367443.529834:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446664704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.529914:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664832 00000100:00100000:2.0:1787367443.529921:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664832 00000100:00100000:3.0:1787367443.529929:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446664704:12345-0@lo:400:kworker.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367443.529941:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787367443.529999:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367443.530009:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787367443.530061:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb396d80 x1874190446664704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367443.530082:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446664704:0@lo:400:kworker.0 00000100:00100000:1.0:1787367443.530386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787367443.530411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446664320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367443.530458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446664448:12345-0@lo:400:kworker.0 Request processed in 3808us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367443.530473:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787367443.530498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367443.530499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446664832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.530576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446664832:12345-0@lo:400:kworker.0 Request processed in 92us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367443.530584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367443.530747:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446664576:0@lo:400:kworker.0 00000100:00100000:2.0:1787367443.531015:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446664448:0@lo:400:kworker.0 00000100:00100000:1.0:1787367443.531106:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446664320:12345-0@lo:400:kworker.0 Request processed in 709us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367443.531114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787367443.531350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446664832:0@lo:400:kworker.0 00000100:00100000:1.0:1787367443.531363:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446664320:0@lo:400:kworker.0 00010000:00010000:3.0:1787367444.100503:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367445.128052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367445.577413:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367445.583383:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446664960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367445.583510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367445.583990:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446664960 00000100:00100000:2.0:1787367445.584004:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446664960 00000100:00100000:2.0:1787367445.584158:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787367445.584173:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446664960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367445.584270:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367445.584374:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446664960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367445.584383:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787367445.584473:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367445.584559:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb395f80 x1874190446664960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367445.584588:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446664960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367445.765252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367445.765329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367445.765481:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661568 00000100:00100000:0.0:1787367445.765497:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661568 00000100:00100000:0.0:1787367445.765594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1787367445.765609:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425661568:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367445.765722:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425661568:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367445.765732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1787367445.765986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661440 00000100:00100000:2.0:1787367445.765992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661440 00000100:00100000:2.0:1787367445.766044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:2.0:1787367445.766054:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425661440:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367445.766091:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425661440:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 40us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367445.766107:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00080000:3.0:1787367445.766251:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787367446.063477:0:9346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.45 00010000:00010000:0.0:1787367446.150345:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367447.174442:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367448.195888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367448.493789:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.45 00000100:00100000:1.0:1787367448.645391:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367448.645431:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446665088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367448.645523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367448.646288:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665088 00000100:00100000:0.0:1787367448.646302:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665088 00000100:00100000:0.0:1787367448.646390:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367448.646402:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446665088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367448.646451:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367448.646536:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446665088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367448.646545:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787367448.647171:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446665600:0@lo:400:kworker.0 00000100:00100000:3.0:1787367448.647266:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367448.647367:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367448.647438:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446665472:0@lo:400:kworker.0 00000100:00100000:3.0:1787367448.647469:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367448.647504:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665600 00000100:00100000:3.0:1787367448.647510:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665600 00000100:00100000:0.0:1787367448.647835:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446665216:0@lo:400:kworker.0 00000100:00100000:3.0:1787367448.647842:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367448.647855:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446665600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367448.647881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367448.647925:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446665728:0@lo:400:kworker.0 00000100:00100000:3.0:1787367448.647927:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446665600:12345-0@lo:400:kworker.0 Request processed in 73us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367448.647939:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367448.647959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367448.647980:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367448.647986:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446665344:0@lo:400:kworker.0 00000100:00100000:0.0:1787367448.648008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367448.648039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665472 00000100:00100000:0.0:1787367448.648043:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665472 00010000:00080000:3.0:1787367448.648065:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8380 x1874190446665600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367448.648079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665728 00000100:00100000:0.0:1787367448.648084:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665728 00000100:00100000:3.0:1787367448.648085:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446665600:0@lo:400:kworker.0 00000100:00080000:1.0:1787367448.648157:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367448.648163:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367448.648165:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367448.648182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665216 00000100:00100000:1.0:1787367448.648186:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665216 00000100:00100000:1.0:1787367448.648373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787367448.648382:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446665216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367448.648444:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446665216:12345-0@lo:400:kworker.0 Request processed in 63us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367448.648450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787367448.648484:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665344 00000100:00100000:1.0:1787367448.648488:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665344 00000100:00100000:1.0:1787367448.648516:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787367448.648524:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446665472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367448.648568:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446665472:12345-0@lo:400:kworker.0 Request processed in 46us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367448.648575:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787367448.648589:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367448.648594:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446665344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367448.648621:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446665344:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367448.648627:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787367448.648985:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787367448.648995:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446665728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367448.649405:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446665344:0@lo:400:kworker.0 00000100:00100000:2.0:1787367448.649417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446665216:0@lo:400:kworker.0 00010000:00080000:2.0:1787367448.649460:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a2300 x1874190446665088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367448.649481:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446665088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367448.649865:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446665728:12345-0@lo:400:kworker.0 Request processed in 870us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367448.649874:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787367448.649981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446665728:0@lo:400:kworker.0 00000100:00100000:0.0:1787367448.650550:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446665472:0@lo:400:kworker.0 00010000:00010000:0.0:1787367449.219430:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367449.919079:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 22:57:28 EDT 2026 00010000:00010000:3.0:1787367450.244721:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367450.692937:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446665856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367450.693077:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367450.693293:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665856 00000100:00100000:3.0:1787367450.693305:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665856 00000100:00100000:3.0:1787367450.693403:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367450.693415:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446665856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367450.693465:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367450.693534:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446665856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367450.693543:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787367450.693617:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813b80 x1874190446665856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367450.693644:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446665856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787367450.693794:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367450.888105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367450.888184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367450.888396:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661696 00000100:00100000:1.0:1787367450.888409:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661696 00000100:00100000:1.0:1787367450.888479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:1.0:1787367450.888489:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425661696:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367450.888576:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2357:x1874190425661696:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367450.888584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:3.0:1787367450.889545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661824 00000100:00100000:3.0:1787367450.889556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661824 00000100:00100000:3.0:1787367450.889647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1787367450.889658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425661824:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:1.0:1787367450.889890:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367450.890106:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425661824:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 89us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367450.890118:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00010000:00010000:1.0:1787367451.268803:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367452.291861:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367453.316247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367453.765454:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446666112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367453.765475:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446665984:0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.765551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367453.765552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367453.765632:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446665984 00000100:00100000:2.0:1787367453.765646:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446665984 00000100:00100000:0.0:1787367453.765665:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666112 00000100:00100000:0.0:1787367453.765669:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666112 00000100:00100000:2.0:1787367453.765703:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787367453.765712:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367453.765714:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446665984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367453.765717:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446666112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367453.765760:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367453.766063:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446665984:12345-0@lo:400:kworker.0 Request processed in 350us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367453.766072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787367453.766143:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446665984:0@lo:400:kworker.0 00000100:00080000:2.0:1787367453.766180:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367453.770427:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446666368:0@lo:400:kworker.0 00000100:00100000:2.0:1787367453.770740:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446666240:0@lo:400:kworker.0 00010000:00080000:1.0:1787367453.770827:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a2300 x1874190446666112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367453.770913:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446666112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367453.770942:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446666624:0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.771981:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367453.772041:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367453.772051:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446666496:0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.772088:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367453.772166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666624 00000100:00100000:1.0:1787367453.772175:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666624 00000100:00100000:1.0:1787367453.772260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787367453.772271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446666624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.772324:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446666624:12345-0@lo:400:kworker.0 Request processed in 55us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367453.772332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787367453.772446:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367453.772475:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446666624:0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.772517:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666496 00000100:00100000:1.0:1787367453.772520:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666496 00000100:00100000:1.0:1787367453.772555:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367453.772561:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446666496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.772597:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446666496:12345-0@lo:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367453.772604:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787367453.772619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367453.772636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787367453.772641:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813800 x1874190446666496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367453.772654:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446666496:0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.772688:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666368 00000100:00100000:1.0:1787367453.772692:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666368 00000100:00100000:1.0:1787367453.772733:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367453.772741:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446666368:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787367453.772744:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367453.772798:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446666368:12345-0@lo:400:kworker.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367453.772804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367453.773121:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446666368:0@lo:400:kworker.0 00000100:00100000:2.0:1787367453.773407:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367453.773677:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666240 00000100:00100000:1.0:1787367453.773685:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666240 00000100:00100000:1.0:1787367453.773769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787367453.773777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446666240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367453.773842:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446666240:12345-0@lo:400:kworker.0 Request processed in 67us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367453.773848:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787367453.773981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446666240:0@lo:400:kworker.0 00000100:00100000:0.0:1787367453.774011:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446666112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7994us (8165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367453.774022:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787367454.339494:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367455.364780:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367455.812455:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367455.812487:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446666752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367455.812581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367455.812636:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666752 00000100:00100000:1.0:1787367455.812647:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666752 00000100:00100000:1.0:1787367455.812721:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367455.812733:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446666752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367455.812782:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367455.812850:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446666752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367455.812858:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787367455.812898:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3811f80 x1874190446666752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367455.812919:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446666752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787367455.813011:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367456.006477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367456.006596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367456.007948:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662080 00000100:00100000:3.0:1787367456.007966:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662080 00000100:00100000:3.0:1787367456.008278:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1787367456.008295:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425662080:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367456.008393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425661952 00000100:00100000:1.0:1787367456.008402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425661952 00000100:00100000:1.0:1787367456.008442:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:1.0:1787367456.008452:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425661952:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367456.008459:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425662080:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 166us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367456.008469:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1787367456.008577:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425661952:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 126us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367456.008585:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00080000:0.0:1787367456.009425:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367456.389537:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367457.416329:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367458.436392:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367458.883657:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446667008:0@lo:400:kworker.0 00000100:00100000:3.0:1787367458.883841:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367458.883909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446667520:0@lo:400:kworker.0 00000100:00100000:3.0:1787367458.883958:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367458.884001:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367458.884008:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446667136:0@lo:400:kworker.0 00000100:00100000:3.0:1787367458.884043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367458.884088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667008 00000100:00100000:3.0:1787367458.884098:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667008 00000100:00100000:3.0:1787367458.884158:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667136 00000100:00100000:3.0:1787367458.884161:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667136 00000100:00100000:3.0:1787367458.884234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367458.884245:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446667008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446666880:0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367458.884561:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446667392:0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367458.884603:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367458.884609:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446667264:0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367458.884670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446666880 00000100:00100000:2.0:1787367458.884674:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446666880 00000100:00100000:2.0:1787367458.884714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787367458.884722:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446666880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884779:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446666880:12345-0@lo:400:kworker.0 Request processed in 58us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367458.884787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787367458.884853:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446666880:0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884919:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667392 00000100:00100000:2.0:1787367458.884923:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667392 00000100:00100000:2.0:1787367458.884946:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787367458.884953:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446667136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.884993:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446667136:12345-0@lo:400:kworker.0 Request processed in 40us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367458.884999:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787367458.885012:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367458.885018:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446667392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.885060:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446667392:12345-0@lo:400:kworker.0 Request processed in 43us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367458.885081:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367458.885106:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667520 00000100:00100000:2.0:1787367458.885111:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667520 00000100:00100000:2.0:1787367458.885140:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667264 00000100:00100000:2.0:1787367458.885143:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667264 00000100:00100000:2.0:1787367458.885166:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367458.885173:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446667520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.885248:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446667520:12345-0@lo:400:kworker.0 Request processed in 76us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367458.885254:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367458.885267:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787367458.885273:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446667264:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787367458.885996:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367458.886005:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367458.886007:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367458.886105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446667648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367458.886160:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367458.886228:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667648 00000100:00100000:1.0:1787367458.886235:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667648 00000100:00100000:1.0:1787367458.886278:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787367458.886372:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446667648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367458.886409:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367458.886456:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446667648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367458.886465:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787367458.887139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446667008:12345-0@lo:400:kworker.0 Request processed in 2891us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367458.887150:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367458.887247:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446667136:0@lo:400:kworker.0 00000100:00100000:3.0:1787367458.887261:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446667008:0@lo:400:kworker.0 00010000:00080000:3.0:1787367458.887279:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3812680 x1874190446667520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787367458.887400:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f904a1f80 x1874190446667648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367458.887421:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446667648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367458.888131:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446667264:12345-0@lo:400:kworker.0 Request processed in 2853us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367458.888143:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787367458.888216:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813100 x1874190446667264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367458.888230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446667264:0@lo:400:kworker.0 00000100:00100000:2.0:1787367458.888245:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446667392:0@lo:400:kworker.0 00000100:00100000:3.0:1787367458.888610:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446667520:0@lo:400:kworker.0 00010000:00010000:3.0:1787367459.462535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367460.487627:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367460.933826:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367460.933859:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446667776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367460.933958:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367460.934063:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667776 00000100:00100000:3.0:1787367460.934093:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667776 00000100:00100000:3.0:1787367460.934182:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367460.934221:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446667776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367460.934280:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367460.934340:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446667776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367460.934348:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787367460.937841:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787367460.937985:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3812680 x1874190446667776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367460.938036:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446667776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367461.125569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367461.125779:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662208 00000100:00100000:2.0:1787367461.125794:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662208 00000100:00100000:2.0:1787367461.125884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:2.0:1787367461.125898:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425662208:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367461.126019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2356:x1874190425662208:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 124us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367461.126055:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:3.0:1787367461.130353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367461.130740:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662336 00000100:00100000:2.0:1787367461.130756:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662336 00000100:00100000:2.0:1787367461.130838:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1787367461.130852:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425662336:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367461.130949:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425662336:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 99us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367461.130958:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00080000:2.0:1787367461.130986:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367461.509228:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367462.531741:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367463.556488:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367464.006970:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367464.007005:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446667904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367464.007137:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367464.007261:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446667904 00000100:00100000:2.0:1787367464.007272:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446667904 00000100:00100000:2.0:1787367464.007352:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787367464.007362:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446667904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367464.007417:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367464.007477:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446667904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367464.007485:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787367464.007512:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787367464.007552:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb395c00 x1874190446667904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367464.007574:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446667904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367464.013066:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446668160:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367464.013298:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787367464.013306:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446668032:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367464.013388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446668544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367464.013453:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446668416:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367464.013515:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367464.013522:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446668288:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367464.013591:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668160 00000100:00100000:1.0:1787367464.013601:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668160 00000100:00100000:1.0:1787367464.013666:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668544 00000100:00100000:1.0:1787367464.013669:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668544 00000100:00100000:1.0:1787367464.013695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668288 00000100:00100000:1.0:1787367464.013698:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668288 00000100:00100000:1.0:1787367464.013723:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787367464.013733:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446668160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013827:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446668160:12345-0@lo:400:kworker.0 Request processed in 95us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367464.013835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787367464.013858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367464.013866:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446668544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013897:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446668544:12345-0@lo:400:kworker.0 Request processed in 33us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367464.013904:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367464.013918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367464.013926:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446668288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.013987:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446668288:12345-0@lo:400:kworker.0 Request processed in 63us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367464.013994:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367464.014020:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668416 00000100:00100000:1.0:1787367464.014024:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668416 00000100:00100000:1.0:1787367464.014053:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787367464.014059:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446668416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.014092:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446668416:12345-0@lo:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367464.014099:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787367464.014144:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446668544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.014157:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446668160:0@lo:400:kworker.0 00000100:00100000:1.0:1787367464.014220:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446668288:0@lo:400:kworker.0 00010000:00080000:1.0:1787367464.014236:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf400380 x1874190446668416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367464.014246:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446668416:0@lo:400:kworker.0 00000100:00100000:2.0:1787367464.014457:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668032 00000100:00100000:2.0:1787367464.014471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668032 00000100:00100000:2.0:1787367464.014510:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787367464.014519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446668032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367464.014571:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446668032:12345-0@lo:400:kworker.0 Request processed in 54us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367464.014578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787367464.014631:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446668032:0@lo:400:kworker.0 00000100:00080000:2.0:1787367464.014651:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367464.014657:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367464.579551:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367464.761886:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:57:43 (1787367463) === 00000100:00100000:1.0:1787367465.161004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.161292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662464 00000100:00100000:2.0:1787367465.161447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662464 00000100:00100000:2.0:1787367465.161745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:2.0:1787367465.161761:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:8144:x1874190425662464:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787367465.161784:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367465.161811:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496000/0xcbf1f1bac53f3783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d593c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367465.161852:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496000/0xcbf1f1bac53f3783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d593c expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367465.161868:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496000/0xcbf1f1bac53f3783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d593c expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367465.161880:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496000, rc 0) 00000100:00100000:2.0:1787367465.162572:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425662464:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 810us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367465.162583:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:2.0:1787367465.178030:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.178647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662592 00000100:00100000:0.0:1787367465.178666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662592 00000100:00100000:0.0:1787367465.178829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:0.0:1787367465.178842:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425662592:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787367465.179388:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425662592:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 545us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.179399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:3.0:1787367465.190726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.190853:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662720 00000100:00100000:2.0:1787367465.190867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662720 00000100:00100000:2.0:1787367465.190960:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:2.0:1787367465.190973:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425662720:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787367465.191774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425662720:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 798us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.191787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:1.0:1787367465.197306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.197417:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662848 00000100:00100000:0.0:1787367465.197433:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662848 00000100:00100000:0.0:1787367465.197519:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:0.0:1787367465.197533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8148:x1874190425662848:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367465.198254:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8148:x1874190425662848:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 718us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.198266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:2.0:1787367465.221262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.221419:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425662976 00000100:00100000:3.0:1787367465.221433:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425662976 00000100:00100000:3.0:1787367465.221497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:3.0:1787367465.221509:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8148:x1874190425662976:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367465.222058:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8148:x1874190425662976:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 539us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.222069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:1.0:1787367465.230829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.232680:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663104 00000100:00100000:0.0:1787367465.232708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663104 00000100:00100000:0.0:1787367465.233312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:0.0:1787367465.233329:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:8144:x1874190425663104:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367465.233355:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367465.233384:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2174600/0xcbf1f1bac53f378a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5966 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.233428:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2174600/0xcbf1f1bac53f378a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5966 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.233443:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2174600/0xcbf1f1bac53f378a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5966 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.233454:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2174600, rc 0) 00000100:00100000:0.0:1787367465.233584:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:8144:x1874190425663104:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 260us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.233593:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:1.0:1787367465.236850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.237248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663232 00000100:00100000:0.0:1787367465.237263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663232 00000100:00100000:0.0:1787367465.237340:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:0.0:1787367465.237353:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:8144:x1874190425663232:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787367465.237392:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787367465.237428:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787367465.237433:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787367465.237436:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787367465.237439:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787367465.241678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:8144:x1874190425663232:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 4302us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.241701:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:1.0:1787367465.246500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.246625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663360 00000100:00100000:0.0:1787367465.246640:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663360 00000100:00100000:0.0:1787367465.246714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:0.0:1787367465.246729:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:8144:x1874190425663360:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367465.246755:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367465.246798:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d596d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.246850:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.246865:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367465.246902:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2174400, rc 0) 00000100:00100000:0.0:1787367465.247010:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8144:x1874190425663360:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 284us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.247019:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:1.0:1787367465.252514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.252636:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663488 00000100:00100000:0.0:1787367465.252650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663488 00000100:00100000:0.0:1787367465.252732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:0.0:1787367465.252743:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8144:x1874190425663488:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787367465.253563:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8144:x1874190425663488:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 817us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.253577:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:2.0:1787367465.263126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.263447:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663616 00000100:00100000:3.0:1787367465.263462:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663616 00000100:00100000:3.0:1787367465.263541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:3.0:1787367465.263552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8144:x1874190425663616:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787367465.263952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8144:x1874190425663616:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 400us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.263963:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:1.0:1787367465.277247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367465.277383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663744 00000100:00100000:0.0:1787367465.277397:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663744 00000100:00100000:0.0:1787367465.277476:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:0.0:1787367465.277488:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8153:x1874190425663744:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367465.277826:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8153:x1874190425663744:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 339us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.277836:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:1.0:1787367465.282576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.283306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425663872 00000100:00100000:2.0:1787367465.283321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425663872 00000100:00100000:2.0:1787367465.283408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:2.0:1787367465.283420:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8153:x1874190425663872:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367465.283803:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:8153:x1874190425663872:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 383us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367465.283814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:2.0:1787367465.291063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.291126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.291328:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664000 00000100:00100000:3.0:1787367465.291345:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664000 00000100:00100000:3.0:1787367465.291405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664128 00000100:00100000:3.0:1787367465.291410:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664128 00000100:00100000:3.0:1787367465.291487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367465.291499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425664128:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367465.291615:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425664128:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 118us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.291625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367465.291645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1787367465.291650:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1874190425664000:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787367465.291683:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f87302e6-9d75-459a-a851-9ecd89807cda@192.168.204.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1787367465.291741:0:5841:0:(genops.c:1385:class_connect()) connect: client f87302e6-9d75-459a-a851-9ecd89807cda, cookie 0xcbf1f1bac53f3798 00000004:00100000:3.0:1787367465.291860:0:5841:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787367465.292299:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf482000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367465.292351:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2355:x1874190425664000:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 698us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.292360:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00080000:0.0:1787367465.292413:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367465.296179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367465.296460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.297120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664256 00000100:00100000:3.0:1787367465.297139:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664256 00000100:00100000:2.0:1787367465.297175:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664384 00000100:00100000:2.0:1787367465.297183:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664384 00000100:00100000:2.0:1787367465.297278:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:2.0:1787367465.297294:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+7:8144:x1874190425664384:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787367465.297362:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787367465.297450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1787367465.297465:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+7:0:x1874190425664256:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787367465.297482:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787367465.299035:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367465.300181:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+7:8144:x1874190425664384:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 2868us (3701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367465.300221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367465.301085:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:0:x1874190425664256:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 3619us (4922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.301117:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1787367465.306651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.307238:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664512 00000100:00100000:3.0:1787367465.307254:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664512 00000100:00100000:3.0:1787367465.307344:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1787367465.307378:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+6:8144:x1874190425664512:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787367465.307517:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+6:8144:x1874190425664512:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 142us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.307525:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1787367465.314618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.314675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367465.314741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367465.314860:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664640 00000100:00100000:3.0:1787367465.314875:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664640 00000100:00100000:3.0:1787367465.314936:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664768 00000100:00100000:3.0:1787367465.314939:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664768 00000100:00100000:3.0:1787367465.314958:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1787367465.314967:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874190425664640:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787367465.315006:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f87302e6-9d75-459a-a851-9ecd89807cda@192.168.204.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000100:00100000:1.0:1787367465.315116:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1787367465.315123:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874190425664768:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787367465.315142:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f87302e6-9d75-459a-a851-9ecd89807cda@192.168.204.23@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1787367465.315185:0:6697:0:(genops.c:1385:class_connect()) connect: client f87302e6-9d75-459a-a851-9ecd89807cda, cookie 0xcbf1f1bac53f379f 00002000:00100000:1.0:1787367465.315236:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f87302e6-9d75-459a-a851-9ecd89807cda/ffff9e8fa01a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787367465.315252:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787367465.315571:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787367465.315696:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425664896 00000100:00100000:0.0:1787367465.315703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425664896 00000020:00000080:3.0:1787367465.315733:0:6696:0:(genops.c:1385:class_connect()) connect: client f87302e6-9d75-459a-a851-9ecd89807cda, cookie 0xcbf1f1bac53f37a6 00002000:00100000:3.0:1787367465.315743:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f87302e6-9d75-459a-a851-9ecd89807cda/ffff9e8fbf487000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367465.315766:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787367465.315771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1787367465.315781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:8144:x1874190425664896:12345-192.168.204.23@tcp:33:mount.lustre.0 00002000:00080000:3.0:1787367465.315947:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787367465.316098:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e8fa01af800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787367465.316181:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf485000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367465.316313:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f87302e6-9d75-459a-a851-9ecd89807cda+6:2355:x1874190425664640:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 1345us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367465.316323:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1787367465.316437:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f87302e6-9d75-459a-a851-9ecd89807cda+6:2355:x1874190425664768:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 1313us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367465.316445:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000004:00200000:0.0:1787367465.316593:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787367465.316718:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:8144:x1874190425664896:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 938us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367465.316726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00010000:00010000:2.0:1787367465.611606:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787367465.624752:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00000001:00100000:1.0:1787367465.627720:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00000100:00100000:0.0:1787367466.055302:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367466.055335:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446668672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367466.055444:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367466.055577:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668672 00000100:00100000:2.0:1787367466.055587:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668672 00000100:00100000:2.0:1787367466.055679:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787367466.055692:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446668672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367466.055726:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787367466.055854:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367466.056010:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446668672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367466.056021:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787367466.060308:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa0027b80 x1874190446668672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367466.060348:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446668672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787367466.630935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367467.153447:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00010000:00010000:0.0:1787367467.656247:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367468.675920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367469.125853:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446668928:0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.125951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126044:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446669440:0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126119:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787367469.126130:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446668800:0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.126161:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446669056:0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126254:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446669312:0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.126275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126377:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669440 00000100:00100000:1.0:1787367469.126385:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669440 00000100:00100000:3.0:1787367469.126403:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367469.126416:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446669184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126468:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787367469.126470:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367469.126483:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446669440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126567:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446669440:12345-0@lo:400:kworker.0 Request processed in 89us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367469.126575:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787367469.126593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367469.126596:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669184 00000100:00100000:1.0:1787367469.126603:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669184 00000100:00100000:3.0:1787367469.126616:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668928 00000100:00100000:3.0:1787367469.126625:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668928 00000100:00100000:1.0:1787367469.126664:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367469.126674:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669056 00000100:00100000:3.0:1787367469.126681:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669056 00000100:00100000:1.0:1787367469.126682:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446669184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.126709:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669312 00000100:00100000:3.0:1787367469.126714:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669312 00000100:00100000:3.0:1787367469.126752:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787367469.126755:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446669184:12345-0@lo:400:kworker.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367469.126769:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446668928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126770:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787367469.126812:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367469.126818:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787367469.126862:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf400e00 x1874190446669440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367469.126882:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446669440:0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.126895:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446668928:12345-0@lo:400:kworker.0 Request processed in 130us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367469.126900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787367469.126917:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787367469.126921:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446668928:0@lo:400:kworker.0 00000100:00100000:0.0:1787367469.126929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446669056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.126943:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367469.126956:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446669312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.126995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446668800 00000100:00100000:1.0:1787367469.127001:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446668800 00000100:00100000:1.0:1787367469.127035:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787367469.127043:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446668800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367469.127277:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446669568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367469.127448:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446669312:12345-0@lo:400:kworker.0 Request processed in 495us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367469.127456:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367469.127515:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446669312:0@lo:400:kworker.0 00000100:00100000:1.0:1787367469.132286:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446668800:12345-0@lo:400:kworker.0 Request processed in 5233us (6111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367469.132320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787367469.132409:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446668800:0@lo:400:kworker.0 00000100:00100000:0.0:1787367469.139625:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446669056:12345-0@lo:400:kworker.0 Request processed in 12692us (13336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367469.139648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787367469.139789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787367469.139897:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf401c00 x1874190446669184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367469.139916:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446669184:0@lo:400:kworker.0 00000100:00100000:2.0:1787367469.139933:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446669056:0@lo:400:kworker.0 00000100:00100000:3.0:1787367469.140120:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669568 00000100:00100000:3.0:1787367469.140132:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669568 00000100:00100000:3.0:1787367469.140220:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367469.140233:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446669568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367469.140288:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367469.140592:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446669568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 361us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367469.140599:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787367469.140697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa0025f80 x1874190446669568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367469.140749:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446669568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787367469.699503:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367470.342403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367470.342526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367470.342591:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665280 00000100:00100000:0.0:1787367470.342605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665280 00000100:00100000:0.0:1787367470.342689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1787367470.342703:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665280:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367470.342834:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665280:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 135us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367470.342844:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00080000:0.0:1787367470.343037:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367470.344062:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665024 00000100:00100000:2.0:1787367470.344078:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665024 00000100:00100000:2.0:1787367470.344214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:2.0:1787367470.344235:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425665024:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367470.344331:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425665024:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367470.344339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:1.0:1787367470.366303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367470.366405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367470.366448:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665152 00000100:00100000:1.0:1787367470.366460:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665152 00000100:00100000:1.0:1787367470.366567:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:1.0:1787367470.366581:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425665152:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367470.367017:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665536 00000100:00100000:0.0:1787367470.367023:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665536 00000100:00100000:0.0:1787367470.367112:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1787367470.367123:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665536:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:3.0:1787367470.367263:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367470.367270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367470.373075:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425665152:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 6286us (6460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367470.373097:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:0.0:1787367470.374372:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665536:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 7242us (8071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367470.374387:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:3.0:1787367470.374936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367470.375133:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665408 00000100:00100000:0.0:1787367470.375146:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665408 00000100:00100000:0.0:1787367470.375901:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1787367470.375920:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665408:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367470.376146:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425665408:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 233us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367470.376164:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00080000:3.0:1787367470.377632:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367470.725443:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367471.173578:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446669696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367471.173698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367471.173866:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669696 00000100:00100000:3.0:1787367471.173877:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669696 00000100:00100000:3.0:1787367471.173964:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787367471.173977:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446669696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367471.174027:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367471.174106:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446669696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367471.174116:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787367471.174174:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3812a00 x1874190446669696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367471.174239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446669696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787367471.175755:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787367471.213081:0:10316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787367471.749255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367472.772670:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367473.796554:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367474.244392:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446669824:0@lo:400:kworker.0 00000100:00100000:2.0:1787367474.244507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367474.244571:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446670336:0@lo:400:kworker.0 00000100:00100000:2.0:1787367474.244601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367474.244635:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787367474.244641:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446669952:0@lo:400:kworker.0 00000100:00100000:2.0:1787367474.245081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367474.245112:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446670464:0@lo:400:kworker.0 00000100:00100000:2.0:1787367474.245144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367474.245184:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670336 00000100:00100000:2.0:1787367474.245220:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670336 00000100:00100000:2.0:1787367474.245285:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669952 00000100:00100000:2.0:1787367474.245288:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669952 00000100:00100000:2.0:1787367474.245314:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787367474.245325:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446670336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.245552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446670080:0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.245593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367474.245609:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367474.245634:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367474.245660:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367474.245667:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670208:0@lo:400:kworker.0 00000100:00100000:3.0:1787367474.245798:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670464 00000100:00100000:3.0:1787367474.245804:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670464 00000100:00100000:3.0:1787367474.245845:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787367474.245854:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446670464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367474.251210:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446670464:12345-0@lo:400:kworker.0 Request processed in 5325us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367474.251234:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787367474.252935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367474.253006:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670208 00000100:00100000:3.0:1787367474.253020:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670208 00000100:00100000:1.0:1787367474.253059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446669824 00000100:00100000:1.0:1787367474.253063:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446669824 00000100:00100000:3.0:1787367474.253090:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367474.253093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787367474.253101:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.253101:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446669824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367474.253379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446670336:12345-0@lo:400:kworker.0 Request processed in 8053us (8774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367474.253393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787367474.253420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670080 00000100:00100000:2.0:1787367474.253424:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670080 00000100:00100000:3.0:1787367474.253553:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670208:12345-0@lo:400:kworker.0 Request processed in 454us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367474.253578:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787367474.253585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787367474.253592:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446669952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.253676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446669824:12345-0@lo:400:kworker.0 Request processed in 576us (9169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367474.253707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787367474.253759:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787367474.253768:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446670080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.253799:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446670080:12345-0@lo:400:kworker.0 Request processed in 33us (8205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367474.253805:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787367474.253826:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670592 00000100:00100000:1.0:1787367474.253829:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670592 00000100:00100000:1.0:1787367474.253858:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787367474.253866:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367474.253912:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367474.253952:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (8318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367474.253959:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787367474.254018:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf400e00 x1874190446670464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367474.254038:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446670464:0@lo:400:kworker.0 00000100:00100000:3.0:1787367474.254053:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446669824:0@lo:400:kworker.0 00000100:00100000:3.0:1787367474.254068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446670336:0@lo:400:kworker.0 00010000:00080000:1.0:1787367474.254161:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf403800 x1874190446670208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367474.254171:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670208:0@lo:400:kworker.0 00000100:00100000:1.0:1787367474.254181:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446670080:0@lo:400:kworker.0 00010000:00080000:1.0:1787367474.254208:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa0025f80 x1874190446670592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367474.254223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367474.254826:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446669952:12345-0@lo:400:kworker.0 Request processed in 1229us (10140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367474.254836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787367474.254886:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367474.254893:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367474.254897:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367474.267098:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446669952:0@lo:400:kworker.0 00010000:00010000:3.0:1787367474.821742:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367475.460941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367475.461002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367475.461039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367475.461063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367475.461101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367475.461161:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666048 00000100:00100000:1.0:1787367475.461175:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666048 00000100:00100000:1.0:1787367475.461278:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666176 00000100:00100000:1.0:1787367475.461282:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666176 00000100:00100000:1.0:1787367475.461306:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1787367475.461317:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425666048:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367475.461447:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665792 00000100:00100000:3.0:1787367475.461452:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665792 00000100:00100000:3.0:1787367475.461488:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665920 00000100:00100000:3.0:1787367475.461492:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665920 00000100:00100000:3.0:1787367475.461515:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:3.0:1787367475.461522:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425665792:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367475.462510:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425665792:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 977us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367475.462525:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:3.0:1787367475.462563:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:1.0:1787367475.462731:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425666048:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 1414us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367475.462741:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:3.0:1787367475.463187:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425665920:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367475.463280:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425665920:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 709us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367475.463290:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:1.0:1787367475.463495:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367475.463505:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425666176:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367475.463538:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425666176:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 36us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367475.463545:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367475.464684:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425665664 00000100:00100000:1.0:1787367475.464701:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425665664 00000100:00080000:0.0:1787367475.465010:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367475.465018:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367475.465022:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367475.465479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:1.0:1787367475.465492:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425665664:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367475.465974:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425665664:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 482us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367475.465984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 222 00010000:00010000:1.0:1787367475.843371:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367476.291734:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367476.291767:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367476.291880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367476.292293:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670720 00000100:00100000:3.0:1787367476.292303:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670720 00000100:00100000:3.0:1787367476.292387:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787367476.292418:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367476.292468:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787367476.292607:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367476.293119:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446670720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 698us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367476.293130:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787367476.298843:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3812a00 x1874190446670720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367476.298885:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446670720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367476.867615:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367477.892785:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367478.915849:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367479.363488:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446670976:0@lo:400:kworker.0 00000100:00100000:1.0:1787367479.363590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367479.363662:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446671488:0@lo:400:kworker.0 00000100:00100000:1.0:1787367479.363691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367479.363794:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446670848:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.363831:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367479.363856:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446671360:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.363876:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367479.363908:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446671232:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.363933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367479.363951:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367479.363957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446671104:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.363979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367479.364008:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670848 00000100:00100000:0.0:1787367479.364027:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670848 00000100:00100000:0.0:1787367479.364077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787367479.364085:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446670848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364134:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446670848:12345-0@lo:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364141:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787367479.364184:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446670976 00000100:00100000:0.0:1787367479.364188:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446670976 00000100:00100000:0.0:1787367479.364235:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671360 00000100:00100000:0.0:1787367479.364238:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671360 00000100:00100000:0.0:1787367479.364260:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671104 00000100:00100000:0.0:1787367479.364262:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671104 00000100:00100000:0.0:1787367479.364278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787367479.364284:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446670976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364319:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446670976:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787367479.364337:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787367479.364343:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446671360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446671360:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787367479.364382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787367479.364386:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446671104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446671104:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787367479.364431:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671488 00000100:00100000:0.0:1787367479.364434:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671488 00000100:00100000:0.0:1787367479.364460:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671232 00000100:00100000:0.0:1787367479.364463:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671232 00000100:00100000:0.0:1787367479.364485:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367479.364490:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446671488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364519:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446671488:12345-0@lo:400:kworker.0 Request processed in 29us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364532:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787367479.364544:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787367479.364550:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446671232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364579:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446671232:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367479.364585:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787367479.364613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367479.364617:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367479.364619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367479.364664:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446671104:0@lo:400:kworker.0 00010000:00080000:0.0:1787367479.364677:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa0025f80 x1874190446671232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367479.364688:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446671232:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364961:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446670848:0@lo:400:kworker.0 00000100:00100000:0.0:1787367479.364975:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446671360:0@lo:400:kworker.0 00000100:00100000:3.0:1787367479.365181:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446671616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367479.365235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367479.365995:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671616 00000100:00100000:2.0:1787367479.366004:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671616 00010000:00080000:1.0:1787367479.366159:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014ed80 x1874190446671488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367479.366174:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446671488:0@lo:400:kworker.0 00000100:00100000:1.0:1787367479.366219:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446670976:0@lo:400:kworker.0 00000100:00100000:2.0:1787367479.367604:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787367479.367616:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446671616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367479.367670:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367479.367753:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446671616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367479.367761:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787367479.370341:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813100 x1874190446671616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367479.370369:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446671616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787367479.950637:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367480.584328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367480.584377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367480.584409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367480.584430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367480.584451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367480.584479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666304 00000100:00100000:3.0:1787367480.584488:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666304 00000100:00100000:3.0:1787367480.584535:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:3.0:1787367480.584546:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425666304:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367480.584866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666432 00000100:00100000:2.0:1787367480.584873:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666432 00000100:00100000:2.0:1787367480.584917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666560 00000100:00100000:2.0:1787367480.584920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666560 00000100:00100000:2.0:1787367480.584944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:2.0:1787367480.584952:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425666432:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367480.585083:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666688 00000100:00100000:0.0:1787367480.585088:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666688 00000100:00100000:0.0:1787367480.585120:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666816 00000100:00100000:0.0:1787367480.585123:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666816 00000100:00100000:0.0:1787367480.585145:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:0.0:1787367480.585153:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666688:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367480.587588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425666304:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 3031us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367480.587604:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:2.0:1787367480.589635:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425666432:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 4670us (5307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367480.589651:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:2.0:1787367480.589694:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:2.0:1787367480.591082:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666560:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367480.591178:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666560:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 1475us (6745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367480.591223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00080000:2.0:1787367480.591258:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367480.591263:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367480.591267:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367480.591403:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666688:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 6248us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367480.591414:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:0.0:1787367480.591445:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1787367480.591458:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666816:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367480.591489:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425666816:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 36us (7036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367480.591495:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00010000:00010000:3.0:1787367480.963729:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367481.413693:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446671744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367481.413775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367481.413934:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671744 00000100:00100000:1.0:1787367481.413942:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671744 00000100:00100000:1.0:1787367481.413997:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367481.414005:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446671744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367481.414043:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367481.415396:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446671744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1383us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367481.415409:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787367481.415509:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787367481.421795:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813b80 x1874190446671744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367481.422649:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446671744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367481.987534:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367483.013812:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367484.037600:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367484.484348:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446672000:0@lo:400:kworker.0 00000100:00100000:2.0:1787367484.484448:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367484.484506:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446671872:0@lo:400:kworker.0 00000100:00100000:3.0:1787367484.484521:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446672128:0@lo:400:kworker.0 00000100:00100000:3.0:1787367484.489975:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672000 00000100:00100000:3.0:1787367484.489988:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672000 00000100:00100000:3.0:1787367484.490046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787367484.490056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446672000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367484.490367:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446672256:0@lo:400:kworker.0 00000100:00100000:0.0:1787367484.490554:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367484.490607:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446672000:12345-0@lo:400:kworker.0 Request processed in 551us (6158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367484.490614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787367484.490704:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446672384:0@lo:400:kworker.0 00000100:00100000:0.0:1787367484.490798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446671872 00000100:00100000:0.0:1787367484.490803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446671872 00000100:00100000:0.0:1787367484.490838:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787367484.490845:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446671872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367484.490889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446671872:12345-0@lo:400:kworker.0 Request processed in 44us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367484.490895:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787367484.492948:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446672000:0@lo:400:kworker.0 00000100:00100000:2.0:1787367484.492963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446672512:0@lo:400:kworker.0 00000100:00100000:2.0:1787367484.493070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367484.493225:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367484.493255:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446672640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367484.493284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367484.493322:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672640 00000100:00100000:3.0:1787367484.493328:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672640 00000100:00100000:3.0:1787367484.493379:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787367484.493388:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446672640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367484.493426:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367484.493468:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446672640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367484.493474:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787367484.493504:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787367484.493788:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813b80 x1874190446672640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367484.493807:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446672640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367484.493890:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672128 00000100:00100000:2.0:1787367484.493894:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672128 00000100:00100000:2.0:1787367484.493939:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787367484.493946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446672128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367484.493991:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446672128:12345-0@lo:400:kworker.0 Request processed in 46us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367484.493997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787367484.494024:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446672128:0@lo:400:kworker.0 00000100:00080000:3.0:1787367484.494151:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367484.494221:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672512 00000100:00100000:0.0:1787367484.494227:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672512 00000100:00100000:0.0:1787367484.494269:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787367484.494278:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f85bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446672512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367484.494344:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f85bb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446672512:12345-0@lo:400:kworker.0 Request processed in 68us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367484.494354:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787367484.494784:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59ca80 x1874190446672512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367484.494805:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446672512:0@lo:400:kworker.0 00000100:00100000:0.0:1787367484.494926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367484.495009:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446671872:0@lo:400:kworker.0 00000100:00100000:1.0:1787367484.495474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367484.495817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672384 00000100:00100000:3.0:1787367484.495823:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672384 00000100:00100000:2.0:1787367484.496066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787367484.496079:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446672384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367484.496149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446672384:12345-0@lo:400:kworker.0 Request processed in 73us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367484.496157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787367484.496258:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367484.496404:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672256 00000100:00100000:0.0:1787367484.496410:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672256 00000100:00100000:0.0:1787367484.496486:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446672384:0@lo:400:kworker.0 00000100:00100000:1.0:1787367484.496701:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787367484.496709:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446672256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367484.496772:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446672256:12345-0@lo:400:kworker.0 Request processed in 63us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367484.496778:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787367484.496948:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59c000 x1874190446672256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367484.496971:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446672256:0@lo:400:kworker.0 00000100:00080000:3.0:1787367484.497136:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787367485.067480:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367485.702764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367485.702839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667072 00000100:00100000:2.0:1787367485.702849:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667072 00000100:00100000:2.0:1787367485.702921:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:2.0:1787367485.702931:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425667072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367485.703017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425667072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367485.703024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00080000:0.0:1787367485.703151:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367485.708646:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367485.708686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367485.708716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367485.708814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367485.708830:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667328 00000100:00100000:3.0:1787367485.708842:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667328 00000100:00100000:1.0:1787367485.708846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667200 00000100:00100000:1.0:1787367485.708852:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667200 00000100:00100000:2.0:1787367485.708944:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667456 00000100:00100000:2.0:1787367485.708949:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667456 00000100:00100000:1.0:1787367485.709019:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:1.0:1787367485.709030:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425667200:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367485.709105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425667200:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367485.709113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:3.0:1787367485.709551:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1787367485.709560:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2355:x1874190425667328:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:3.0:1787367485.709581:0:8211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f37a6 00000100:00080000:3.0:1787367485.709592:0:8211:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf485000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787367485.709613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425666944 00000001:00000004:3.0:1787367485.709672:0:8211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787367485.709690:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425666944 00000100:00100000:0.0:1787367485.709841:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 226 00000100:00100000:0.0:1787367485.709853:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425666944:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367485.709893:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425666944:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 44us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367485.709901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 226 00000100:00100000:3.0:1787367485.710689:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f87302e6-9d75-459a-a851-9ecd89807cda+2:2355:x1874190425667328:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 1127us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367485.710699:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00010000:00010000:3.0:1787367485.710724:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367485.716476:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1787367485.716494:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2355:x1874190425667456:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:2.0:1787367485.716537:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f379f 00000100:00080000:2.0:1787367485.716547:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fa01af800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367485.716594:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787367485.716948:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f87302e6-9d75-459a-a851-9ecd89807cda+2:2355:x1874190425667456:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 458us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367485.716957:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00080000:1.0:1787367485.717251:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787367485.717262:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367485.717415:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367485.717421:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367486.084297:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787367486.089594:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00000020:00000080:0.0:1787367486.089604:0:7644:0:(genops.c:885:class_export_put()) final put ffff9e8fa01a8800/f87302e6-9d75-459a-a851-9ecd89807cda 00000020:00000080:2.0:1787367486.089870:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fa01a8800/f87302e6-9d75-459a-a851-9ecd89807cda for lustre-OST0001 00000020:00000080:2.0:1787367486.089919:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fa01af800 for lustre-OST0001 00000100:00100000:0.0:1787367486.531482:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367486.531514:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446672768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367486.531582:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367486.531789:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672768 00000100:00100000:3.0:1787367486.531796:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672768 00000100:00100000:3.0:1787367486.531882:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787367486.531892:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446672768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367486.531925:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367486.531977:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446672768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367486.531984:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787367486.532045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8a80 x1874190446672768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367486.532063:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446672768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787367486.532220:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367487.117725:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367487.611324:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00000020:00000080:2.0:1787367487.611342:0:6722:0:(genops.c:885:class_export_put()) final put ffff9e8fbf487000/f87302e6-9d75-459a-a851-9ecd89807cda 00000020:00000080:3.0:1787367487.611408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf487000/f87302e6-9d75-459a-a851-9ecd89807cda for lustre-OST0000 00000020:00000080:3.0:1787367487.611454:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbf485000 for lustre-OST0000 00010000:00010000:1.0:1787367488.131822:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367489.155481:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367489.603839:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446672896:0@lo:400:kworker.0 00000100:00100000:3.0:1787367489.603872:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446673152:0@lo:400:kworker.0 00000100:00100000:1.0:1787367489.603971:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446673024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367489.613429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367489.613541:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446673664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367489.613594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367489.613623:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367489.613630:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446673280:0@lo:400:kworker.0 00000100:00100000:3.0:1787367489.613658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367489.613698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673152 00000100:00100000:3.0:1787367489.613704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673152 00000100:00100000:3.0:1787367489.613758:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787367489.613768:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446673152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367489.613837:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446673152:12345-0@lo:400:kworker.0 Request processed in 71us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367489.613844:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787367489.613867:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673280 00000100:00100000:3.0:1787367489.613870:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673280 00000100:00100000:0.0:1787367489.614083:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367489.614140:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446673408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.614172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367489.614396:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673664 00000100:00100000:0.0:1787367489.614402:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673664 00000100:00100000:0.0:1787367489.614449:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367489.614459:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446673664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367489.614494:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367489.614625:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446673664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367489.614633:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367489.614656:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673408 00000100:00100000:0.0:1787367489.614660:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673408 00000100:00100000:0.0:1787367489.614694:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787367489.614702:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446673408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.614817:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446673408:12345-0@lo:400:kworker.0 Request processed in 115us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367489.614824:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787367489.614846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446672896 00000100:00100000:0.0:1787367489.614850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446672896 00000100:00100000:1.0:1787367489.615017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367489.615043:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446673536:0@lo:400:kworker.0 00000100:00100000:1.0:1787367489.615069:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367489.615097:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367489.615102:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367489.615111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367489.615120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673024 00000100:00100000:1.0:1787367489.615124:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673024 00000100:00100000:1.0:1787367489.615150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787367489.615157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446673024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.616698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787367489.616708:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446672896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.616786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446672896:12345-0@lo:400:kworker.0 Request processed in 80us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367489.616794:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787367489.616998:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446673408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.617014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446672896:0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.617078:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673536 00000100:00100000:0.0:1787367489.617083:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673536 00000100:00100000:0.0:1787367489.617114:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787367489.617122:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446673280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.617161:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446673280:12345-0@lo:400:kworker.0 Request processed in 41us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367489.617168:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787367489.617183:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787367489.617322:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446673536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367489.617360:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446673536:12345-0@lo:400:kworker.0 Request processed in 171us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367489.617366:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787367489.617410:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446673024:0@lo:400:kworker.0 00010000:00080000:0.0:1787367489.617425:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1cb480 x1874190446673536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367489.617447:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446673536:0@lo:400:kworker.0 00010000:00080000:0.0:1787367489.617509:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1ca680 x1874190446673280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367489.617519:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446673280:0@lo:400:kworker.0 00010000:00080000:0.0:1787367489.618032:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59c000 x1874190446673664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367489.618051:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446673664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367489.618071:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446673152:0@lo:400:kworker.0 00000100:00100000:1.0:1787367489.619480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446673024:12345-0@lo:400:kworker.0 Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367489.619495:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000001:02000400:2.0:1787367489.708840:0:11018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787367490.179861:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367490.818156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367490.818212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367490.818241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367490.818268:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667840 00000100:00100000:3.0:1787367490.818276:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667840 00000100:00100000:3.0:1787367490.818333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667712 00000100:00100000:3.0:1787367490.818336:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667712 00000100:00100000:3.0:1787367490.818360:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:3.0:1787367490.818369:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425667840:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367490.818453:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425667840:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367490.818472:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:3.0:1787367490.818503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:3.0:1787367490.818510:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425667712:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367490.818538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425667712:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367490.818544:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:0.0:1787367490.820014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667584 00000100:00100000:0.0:1787367490.820024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667584 00000100:00100000:0.0:1787367490.820078:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 228 00000100:00100000:0.0:1787367490.820086:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425667584:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367490.820152:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425667584:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 67us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367490.820160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 228 00000100:00080000:0.0:1787367490.820226:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787367491.205116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367491.651581:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446673792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367491.651661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367491.651780:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446673792 00000100:00100000:3.0:1787367491.651789:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446673792 00000100:00100000:3.0:1787367491.651856:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367491.651875:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446673792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367491.651914:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367491.651968:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446673792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367491.651975:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787367491.652017:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1ca680 x1874190446673792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367491.652036:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446673792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787367491.652465:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787367492.228036:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787367493.114226:0:11166:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca4a7c410 20000000:00000080:1.0:1787367493.114244:0:11166:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fafae7000 uarg=0000000000000000 20000000:01000000:1.0:1787367493.114290:0:11166:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787367493.114296:0:11166:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787367493.114300:0:11166:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787367493.116678:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787367493.116970:0:11166:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787367493.128157:0:11166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367493.128911:0:11166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128932:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128940:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128947:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128958:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128966:0:11166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.128974:0:11166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.129463:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.129496:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 12 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.129584:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446673920:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367493.129763:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.129772:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 12 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.129780:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674048:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367493.129815:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.129823:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 18 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.129832:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674176:0@lo:104: 00000100:00100000:2.0:1787367493.129872:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367493.129915:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.129923:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 18 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.129931:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674304:0@lo:104: 00000100:00100000:2.0:1787367493.129955:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367493.129992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674304 00000100:00100000:2.0:1787367493.129998:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674304 00000100:00100000:0.0:1787367493.130169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674176 00000100:00100000:0.0:1787367493.130177:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674176 00000100:00100000:0.0:1787367493.130231:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787367493.130268:0:11166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367493.130279:0:11166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 18 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.130290:0:11166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674432:0@lo:104: 00000100:00100000:2.0:1787367493.130318:0:11166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367493.130343:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787367493.130350:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1787367493.130387:0:11166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277240 going to sleep for 11 seconds 00000100:00100000:0.0:1787367493.130578:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:11166:x1874190446674304:12345-0@lo:104: 00010000:00010000:0.0:1787367493.130592:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.130654:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787367493.130661:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:11166:x1874190446674304:12345-0@lo:104: Request processed in 423us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.130668:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787367493.130687:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674432 00000100:00100000:0.0:1787367493.130691:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674432 00000100:00100000:0.0:1787367493.130709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787367493.130717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:11166:x1874190446674176:12345-0@lo:104: 00010000:00010000:0.0:1787367493.130726:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.130736:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674304:0@lo:104: 00010000:00010000:0.0:1787367493.130772:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787367493.130779:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674176:0@lo:104: 00000100:00100000:0.0:1787367493.130790:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+4:11166:x1874190446674176:12345-0@lo:104: Request processed in 72us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.130798:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787367493.130813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367493.130820:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:11166:x1874190446674432:12345-0@lo:104: 00010000:00010000:0.0:1787367493.130828:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.130873:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787367493.130878:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:11166:x1874190446674432:12345-0@lo:104: Request processed in 60us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.130884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787367493.130901:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787367493.130907:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.130915:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367493.130919:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.130928:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367493.130936:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367493.130941:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367493.130974:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.130990:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367493.131012:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131019:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f600/0xcbf1f1bac53f3760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3767 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131031:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367493.131035:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131041:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367493.131044:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131051:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367493.131058:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367493.131064:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367493.131078:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131085:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367493.131090:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131098:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81497400/0xcbf1f1bac53f376e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3775 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131115:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367493.131119:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131124:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e200 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367493.131127:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131134:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367493.131140:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367493.131144:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787367493.131157:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131162:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367493.131178:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131184:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5e200/0xcbf1f1bac53f3752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f3759 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131226:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367493.131227:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367493.131229:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367493.131235:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367493.131246:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367493.131266:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446674560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367493.131301:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367493.131330:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367493.131337:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446674688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367493.131359:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367493.131402:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446674816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367493.131425:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367493.131458:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674560 00000100:00100000:0.0:1787367493.131462:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674560 00010000:00010000:0.0:1787367493.131486:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 19 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367493.131505:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674688 00000100:00100000:0.0:1787367493.131508:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674688 00010000:00010000:0.0:1787367493.131519:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 20 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367493.131531:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674816 00000100:00100000:0.0:1787367493.131534:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674816 00010000:00010000:0.0:1787367493.131543:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 21 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367493.131553:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367493.131559:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92391450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+21:3312:x1874190446674560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367493.131569:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367493.131574:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 21 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131595:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 21 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131607:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f3767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3760 expref: 21 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131621:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367493.131649:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92391450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+20:3312:x1874190446674560:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.131656:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787367493.131692:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367493.131699:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446674688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367493.131706:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367493.131711:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 19 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131720:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 19 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131730:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f3775 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f376e expref: 19 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131739:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367493.131761:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+18:3312:x1874190446674688:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.131767:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787367493.131779:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367493.131786:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+17:3310:x1874190446674816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367493.131799:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367493.131804:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 17 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131813:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 17 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.131822:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367493.131848:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+17:3310:x1874190446674816:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367493.131854:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787367493.131890:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446674816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367493.131935:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446674688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367493.131943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446674560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367493.132595:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2175200/0xcbf1f1bac53f3759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f3752 expref: 16 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367493.132608:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674432:0@lo:104: 00000100:00100000:2.0:1787367493.141020:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446673920:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367493.141041:0:11166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11166:1874190446674048:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367493.141089:0:11166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367493.145277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367493.145397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367493.145428:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668096 00000100:00100000:3.0:1787367493.145445:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668096 00010000:00010000:3.0:1787367493.145509:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 13 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367493.145562:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425667968 00000100:00100000:3.0:1787367493.145583:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425667968 00010000:00010000:3.0:1787367493.145603:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 14 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367493.145623:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1787367493.145644:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+14:2357:x1874190425668096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367493.145668:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367493.145680:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 14 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367493.145695:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 14 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367493.145715:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f377c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5935 expref: 14 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367493.145741:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367493.145942:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:3.0:1787367493.145954:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425667968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367493.145969:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367493.145976:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 13 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.145993:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 13 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146012:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2174400/0xcbf1f1bac53f3791 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d596d expref: 13 pid: 5836 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146031:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146042:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146064:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146073:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146082:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146101:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146109:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367493.146115:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146125:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146150:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367493.146163:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367493.146276:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:2357:x1874190425668096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 636us (1005us total) trans 0 rc 0/0 00010000:00010000:0.0:1787367493.146412:0:11166:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.146422:0:11166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367493.146429:0:11166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496c00/0xcbf1f1bac53f37ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367493.146980:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1787367493.163002:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:2357:x1874190425667968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 17030us (17586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367493.163032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00010000:00010000:0.0:1787367493.252493:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367494.275641:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367494.596797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367494.598477:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668224 00000100:00100000:0.0:1787367494.598507:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668224 00000100:00100000:0.0:1787367494.598598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:0.0:1787367494.598610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:5599:x1874190425668224:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367494.598634:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367494.598659:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5997 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.598696:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.598715:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.598726:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2049400, rc 0) 00000100:00100000:0.0:1787367494.598813:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668224:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 205us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.598821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:0.0:1787367494.605947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367494.606441:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668352 00000100:00100000:2.0:1787367494.606457:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668352 00000100:00100000:2.0:1787367494.606610:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:2.0:1787367494.606623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668352:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.607023:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668352:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 402us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.607033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:1.0:1787367494.618911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367494.620094:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668480 00000100:00100000:2.0:1787367494.620112:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668480 00000100:00100000:2.0:1787367494.620237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:2.0:1787367494.620251:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668480:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.620624:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668480:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 375us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.620633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:3.0:1787367494.628594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367494.628978:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668608 00000100:00100000:2.0:1787367494.628992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668608 00000100:00100000:2.0:1787367494.629069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:2.0:1787367494.629082:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425668608:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367494.629106:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367494.629132:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d599e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367494.629172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367494.629185:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367494.629243:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497200, rc 0) 00000100:00100000:2.0:1787367494.629949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425668608:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 244us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.629979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:0.0:1787367494.631682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367494.631962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668736 00000100:00100000:2.0:1787367494.631974:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668736 00000100:00100000:2.0:1787367494.632043:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:2.0:1787367494.632054:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425668736:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.632649:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425668736:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 593us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.632660:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:3.0:1787367494.637074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367494.637231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668864 00000100:00100000:0.0:1787367494.637246:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668864 00000100:00100000:0.0:1787367494.637310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:0.0:1787367494.637323:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425668864:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367494.637639:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425668864:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 317us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.637649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 234 10000000:01000000:0.0:1787367494.723285:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787367494.723308:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbf411800 from 7 10000000:01000000:0.0:1787367494.723314:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367494.726731:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.726754:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.726768:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367494.726803:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446674944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367494.726899:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367494.726964:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f918bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367494.727027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446674944 00000100:00100000:0.0:1787367494.727035:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446674944 00000100:00100000:0.0:1787367494.727097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787367494.727106:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446674944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367494.727124:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367494.727140:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f37c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.727170:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367494.727745:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446675072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.727799:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.727830:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446675584:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.727856:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.727880:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367494.727886:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446675456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.727909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.727958:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446675328:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.727984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.728024:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367494.728030:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446675200:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.728083:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675072 00000100:00100000:3.0:1787367494.728088:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675072 00000100:00100000:3.0:1787367494.728125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675456 00000100:00100000:3.0:1787367494.728128:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675456 00000100:00100000:3.0:1787367494.728153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675200 00000100:00100000:3.0:1787367494.728156:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675200 00000100:00100000:3.0:1787367494.728172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787367494.728180:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446675072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728261:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446675072:12345-0@lo:400:kworker.0 Request processed in 82us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.728269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787367494.728288:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787367494.728294:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446675456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728620:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446675456:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.728628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787367494.728643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787367494.728649:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446675200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728687:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446675200:12345-0@lo:400:kworker.0 Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.728705:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787367494.728727:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675584 00000100:00100000:3.0:1787367494.728742:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675584 00000100:00100000:3.0:1787367494.728775:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675328 00000100:00100000:3.0:1787367494.728778:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675328 00000100:00100000:3.0:1787367494.728795:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367494.728800:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446675584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728832:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446675584:12345-0@lo:400:kworker.0 Request processed in 31us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.728839:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787367494.728849:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787367494.728855:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446675328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.728880:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446675328:12345-0@lo:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.728887:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787367494.729016:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367494.729021:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367494.729025:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367494.729063:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446675456:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.729076:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446675072:0@lo:400:kworker.0 00010000:00080000:3.0:1787367494.729090:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c9880 x1874190446675584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367494.729101:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446675584:0@lo:400:kworker.0 00000100:00100000:3.0:1787367494.729142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446675200:0@lo:400:kworker.0 00010000:00080000:3.0:1787367494.729153:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c8380 x1874190446675328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367494.729162:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446675328:0@lo:400:kworker.0 00010000:00010000:0.0:1787367494.729364:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.729377:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2048600, rc 0) 00000100:00100000:0.0:1787367494.729423:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446674944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2317us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.729438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787367494.730832:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446675712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367494.730930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367494.731085:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675712 00000100:00100000:3.0:1787367494.731094:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675712 00000100:00100000:3.0:1787367494.731156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367494.731166:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446675712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367494.731232:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367494.731289:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446675712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367494.731298:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787367494.731599:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446674944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367494.731629:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367494.731643:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367494.731733:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446675840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.731772:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367494.731806:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277540 going to sleep for 11 seconds 00000100:00100000:2.0:1787367494.731824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675840 00000100:00100000:2.0:1787367494.731828:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675840 00000100:00100000:2.0:1787367494.731857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787367494.731863:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446675840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.732159:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446675840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.732167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787367494.732247:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446675840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.732281:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446675968:0@lo:503:ll_cfg_requeue.0 00010000:00080000:3.0:1787367494.733552:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59d180 x1874190446675712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367494.733585:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446675712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367494.734511:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367494.734610:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277540 going to sleep for 11 seconds 00000100:00100000:0.0:1787367494.740621:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446675968 00000100:00100000:0.0:1787367494.740642:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446675968 00000100:00100000:1.0:1787367494.740839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787367494.740852:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446675968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.741176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446675968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (6668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367494.741185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787367494.741389:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446675968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787367494.750514:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787367494.751157:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787367494.751543:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367494.751559:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.751575:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367494.751588:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367494.751592:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fb88be800 from 7 10000000:01000000:1.0:1787367494.751596:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367494.751654:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.751663:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.751677:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367494.751710:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.751811:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367494.751864:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367494.756897:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676096 00000100:00100000:0.0:1787367494.756919:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676096 00000100:00100000:0.0:1787367494.757005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787367494.757018:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446676096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367494.757045:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367494.757071:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f37d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.757112:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.757126:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.757136:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2048a00, rc 0) 00000100:00100000:0.0:1787367494.757276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.757284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787367494.759959:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367494.760004:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367494.760021:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367494.760143:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.760262:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367494.760339:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277540 going to sleep for 11 seconds 00000100:00100000:0.0:1787367494.760423:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676224 00000100:00100000:0.0:1787367494.760432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676224 00000100:00100000:0.0:1787367494.760508:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787367494.760518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367494.760880:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.760890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787367494.761029:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.761069:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.761113:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367494.761148:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367494.761256:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676352 00000100:00100000:1.0:1787367494.761261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676352 00000100:00100000:1.0:1787367494.761290:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787367494.761298:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.761501:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367494.761509:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787367494.761548:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787367494.762671:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787367494.770275:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787367494.770324:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367494.770353:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.770368:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367494.770381:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367494.770385:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92200800 from 7 10000000:01000000:1.0:1787367494.770388:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367494.770440:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.770450:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.770464:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367494.770509:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.770606:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367494.770664:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367494.771000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676480 00000100:00100000:0.0:1787367494.771011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676480 00000100:00100000:0.0:1787367494.771078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787367494.771090:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446676480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367494.771107:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367494.771124:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f37de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.771154:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.771166:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.771176:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2049000, rc 0) 00000100:00100000:0.0:1787367494.771260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446676480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367494.771269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787367494.771630:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367494.771651:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367494.771661:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367494.771819:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.771859:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367494.771897:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367494.772006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676608 00000100:00100000:2.0:1787367494.772012:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676608 00000100:00100000:2.0:1787367494.772051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787367494.772060:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446676608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.772602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446676608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 542us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.772611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787367494.772823:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.772869:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367494.772916:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367494.772949:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367494.773008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676736 00000100:00100000:2.0:1787367494.773015:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676736 00000100:00100000:2.0:1787367494.773089:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787367494.773099:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446676736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367494.773350:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446676736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367494.773357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787367494.773429:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446676736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787367494.780633:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787367494.781114:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787367494.781144:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367494.781160:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367494.783300:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367495.308146:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367495.940864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367495.940944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367495.941097:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425668992 00000100:00100000:2.0:1787367495.941108:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425668992 00000100:00100000:2.0:1787367495.941172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:2.0:1787367495.941183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425668992:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367495.941286:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425668992:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367495.941292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669248 00000100:00100000:2.0:1787367495.941296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:3.0:1787367495.941299:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669248 00000100:00100000:3.0:1787367495.941370:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:3.0:1787367495.941380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425669248:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367495.941417:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425669248:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 39us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367495.941424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00080000:3.0:1787367495.941445:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367495.942638:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367495.942765:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669120 00000100:00100000:1.0:1787367495.942771:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669120 00000100:00100000:1.0:1787367495.942838:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:1.0:1787367495.942848:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425669120:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:3.0:1787367495.942882:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367495.942937:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425669120:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367495.942945:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00010000:00010000:0.0:1787367496.328090:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367496.771355:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367496.771380:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446676864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367496.771465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367496.771650:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676864 00000100:00100000:0.0:1787367496.771659:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676864 00000100:00100000:0.0:1787367496.771733:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367496.771745:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446676864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367496.771783:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367496.771841:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446676864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367496.771848:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787367496.771882:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3813b80 x1874190446676864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367496.771903:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446676864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787367496.771972:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787367497.347124:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367497.347391:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367498.371368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367499.396187:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367499.845919:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446676992:0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367499.846049:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446677504:0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367499.846109:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787367499.846115:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446677120:0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846139:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367499.846155:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446677632:0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846180:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367499.846250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677504 00000100:00100000:3.0:1787367499.846257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677504 00000100:00100000:3.0:1787367499.846308:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677120 00000100:00100000:3.0:1787367499.846311:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677120 00000100:00100000:3.0:1787367499.846331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787367499.846340:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446677504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446677504:12345-0@lo:400:kworker.0 Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367499.846463:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787367499.846482:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787367499.846489:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446677120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846518:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446677120:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367499.846524:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787367499.846543:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677632 00000100:00100000:3.0:1787367499.846546:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677632 00000100:00100000:3.0:1787367499.846575:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787367499.846582:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446677632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846625:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446677632:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367499.846632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787367499.846646:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367499.846650:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367499.846677:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446677120:0@lo:400:kworker.0 00010000:00080000:3.0:1787367499.846689:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3474000 x1874190446677632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367499.846699:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446677632:0@lo:400:kworker.0 00000100:00100000:3.0:1787367499.846707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446677504:0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847013:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446677248:0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367499.847073:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446677760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367499.847104:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367499.847132:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367499.847138:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446677376:0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847171:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367499.847245:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446676992 00000100:00100000:2.0:1787367499.847249:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446676992 00000100:00100000:2.0:1787367499.847278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787367499.847284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446676992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847324:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446676992:12345-0@lo:400:kworker.0 Request processed in 40us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367499.847330:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787367499.847357:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677248 00000100:00100000:2.0:1787367499.847361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677248 00000100:00100000:2.0:1787367499.847404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787367499.847410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446677248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847445:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446677248:12345-0@lo:400:kworker.0 Request processed in 36us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367499.847450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787367499.847469:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677376 00000100:00100000:2.0:1787367499.847472:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677376 00000100:00100000:2.0:1787367499.847498:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787367499.847504:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446677376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847533:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446677376:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367499.847539:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787367499.847563:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367499.847566:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787367499.847582:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb1c9f80 x1874190446677376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367499.847594:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446677376:0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446677248:0@lo:400:kworker.0 00000100:00100000:2.0:1787367499.847639:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446676992:0@lo:400:kworker.0 00000100:00100000:1.0:1787367499.847770:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677760 00000100:00100000:1.0:1787367499.847775:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677760 00000100:00100000:1.0:1787367499.847810:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787367499.847818:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446677760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367499.847847:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367499.847887:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446677760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367499.847893:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787367499.848298:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59d880 x1874190446677760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367499.848315:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446677760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787367500.420849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367501.066967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367501.067007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367501.067040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669376 00000100:00100000:2.0:1787367501.067051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669376 00000100:00100000:3.0:1787367501.067099:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669632 00000100:00100000:1.0:1787367501.067099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367501.067106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669632 00000100:00100000:2.0:1787367501.067106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 246 00000100:00100000:2.0:1787367501.067118:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425669376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367501.067125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669504 00000100:00100000:1.0:1787367501.067129:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669504 00000100:00100000:3.0:1787367501.067165:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1787367501.067175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425669632:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367501.067237:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425669376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 118us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367501.067252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425669632:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367501.067261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 246 00000100:00100000:3.0:1787367501.067265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1787367501.067287:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:3.0:1787367501.067296:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425669504:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367501.067325:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425669504:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367501.067331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00080000:1.0:1787367501.074970:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367501.446332:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367501.884727:0:11466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:58:20 (1787367500) === 00000100:00100000:0.0:1787367501.894982:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446677888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367501.895062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367501.895150:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446677888 00000100:00100000:1.0:1787367501.895159:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446677888 00000100:00100000:1.0:1787367501.895256:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787367501.895267:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446677888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367501.895319:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787367501.895394:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367501.895487:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446677888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367501.895495:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787367501.895667:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014c700 x1874190446677888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367501.895694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446677888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367502.470459:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367502.723655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367502.723726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367502.723864:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669888 00000100:00100000:2.0:1787367502.723876:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669888 00000100:00100000:1.0:1787367502.723890:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425669760 00000100:00100000:1.0:1787367502.723897:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425669760 00000100:00100000:2.0:1787367502.723937:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367502.723947:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1787367502.723953:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9698:x1874190425669888:12345-192.168.204.23@tcp:700:mkdir.0 00000100:00100000:1.0:1787367502.723962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425669760:12345-192.168.204.23@tcp:41:mkdir.0 00000004:00000024:1.0:1787367502.724003:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787367502.724053:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9698:x1874190425669888:12345-192.168.204.23@tcp:700:mkdir.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367502.724062:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367502.724077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2358:x1874190425669760:12345-192.168.204.23@tcp:41:mkdir.0 Request processed in 118us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367502.724086:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:1.0:1787367502.731270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367502.732031:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425670144 00000100:00100000:2.0:1787367502.732045:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425670144 00000100:00100000:2.0:1787367502.732117:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1787367502.732127:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:9698:x1874190425670144:12345-192.168.204.23@tcp:36:mkdir.0 00010000:00010000:2.0:1787367502.732225:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367502.732273:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f80031200/0xcbf1f1bac53f36cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5920 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.732296:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367502.732308:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367502.733444:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.733464:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.733476:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.733532:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.733541:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.733561:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367502.740407:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787367502.740427:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740438:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740446:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740464:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367502.740468:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740476:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740495:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367502.740498:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367502.740503:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.740509:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367502.740531:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006267aacd reply state 00000000c92e9f97 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367502.740541:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367502.740891:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9698:x1874190425670144:12345-192.168.204.23@tcp:36:mkdir.0 Request processed in 8760us (9627us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787367502.740900:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00010000:00010000:3.0:1787367502.760768:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760785:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760794:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760801:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367502.760806:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760813:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760835:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e8f890a8800) 00010000:00010000:3.0:1787367502.760839:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367502.760844:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.760850:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f37f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367502.781170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367502.781383:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425670272 00000100:00100000:2.0:1787367502.781395:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425670272 00000100:00100000:2.0:1787367502.781456:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1787367502.781466:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:9699:x1874190425670272:12345-192.168.204.23@tcp:101:chmod.0 00010000:00010000:2.0:1787367502.781488:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367502.781512:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59a5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781602:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781617:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781628:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367502.781692:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787367502.781696:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367502.781741:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781769:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f37fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59a5 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781788:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59a5 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.781798:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367502.781801:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367502.781804:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496e00, rc 0) 00000100:00100000:2.0:1787367502.781869:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9699:x1874190425670272:12345-192.168.204.23@tcp:101:chmod.0 Request processed in 404us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367502.781876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1787367502.786699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367502.786771:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425670528 00000100:00100000:3.0:1787367502.786782:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425670528 00000100:00100000:3.0:1787367502.786839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1787367502.786848:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9699:x1874190425670528:12345-192.168.204.23@tcp:36:chmod.0 00010000:00010000:3.0:1787367502.786901:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367502.786926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59a5 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.786959:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367502.786971:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367502.786994:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.787006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367502.787016:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367502.787687:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000434e6083 reply state 000000003869f7f8 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367502.787699:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787367502.787714:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787367502.787816:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:9699:x1874190425670528:12345-192.168.204.23@tcp:36:chmod.0 Request processed in 967us (1126us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787367502.787824:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00010000:00010000:2.0:1787367502.791257:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791300:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791309:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791326:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367502.791332:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791340:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791359:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f91b61f00) 00010000:00010000:2.0:1787367502.791362:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367502.791367:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.791373:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e800/0xcbf1f1bac53f3808 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367502.827826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367502.828481:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425670656 00000100:00100000:1.0:1787367502.828493:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425670656 00000100:00100000:0.0:1787367502.828668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1787367502.828679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9700:x1874190425670656:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:0.0:1787367502.828719:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367502.828744:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048400/0xcbf1f1bac53f380f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59ac expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828812:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828826:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828838:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367502.828904:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787367502.828907:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367502.828946:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828970:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048400/0xcbf1f1bac53f380f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ac expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828990:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ac expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367502.828999:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18000) 00010000:00010000:0.0:1787367502.829002:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367502.829005:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fc2048c00, rc 0) 00000100:00100000:0.0:1787367502.829095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:9700:x1874190425670656:12345-192.168.204.23@tcp:101:chown.0 Request processed in 417us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367502.829103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:3.0:1787367502.834170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367502.834686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425670784 00000100:00100000:2.0:1787367502.834698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425670784 00000100:00100000:2.0:1787367502.834767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1787367502.834776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:9700:x1874190425670784:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:2.0:1787367502.834798:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367502.834818:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f381d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59b3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834900:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834926:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834941:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834947:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.834953:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835066:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835082:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367502.835119:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787367502.835123:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367502.835150:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835183:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835224:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835232:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835238:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367502.835513:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835522:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18000) 00010000:00010000:2.0:1787367502.835536:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367502.835541:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835546:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f3824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835559:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835565:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835570:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835582:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367502.835585:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835591:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835598:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367502.835601:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367502.835603:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f382b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835642:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f381d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59b3 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835656:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59b3 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.835664:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367502.835666:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367502.835668:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496e00, rc 0) 00000100:00100000:2.0:1787367502.835724:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:9700:x1874190425670784:12345-192.168.204.23@tcp:101:chown.0 Request processed in 949us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367502.835732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1787367502.842616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367502.842720:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671040 00000100:00100000:1.0:1787367502.842731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671040 00000100:00100000:1.0:1787367502.842793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1787367502.842803:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:9700:x1874190425671040:12345-192.168.204.23@tcp:36:chown.0 00010000:00010000:1.0:1787367502.842863:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367502.842893:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f3832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59b3 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367502.842915:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367502.842926:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367502.842950:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367502.842963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367502.842973:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367502.961012:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787367502.961164:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7aae99e reply state 00000000511ba744 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367502.961209:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787367502.961492:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787367502.961704:0:5841:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787367502.961731:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9700:x1874190425671040:12345-192.168.204.23@tcp:36:chown.0 Request processed in 118925us (119121us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787367502.961740:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00010000:00010000:2.0:1787367502.961827:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961844:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961851:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961857:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367502.961862:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961870:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961886:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:2.0:1787367502.961889:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367502.961893:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367502.961899:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367503.005356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.005432:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671168 00000100:00100000:0.0:1787367503.005443:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671168 00000100:00100000:0.0:1787367503.005529:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1787367503.005541:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:9701:x1874190425671168:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:0.0:1787367503.005565:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367503.005586:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048400/0xcbf1f1bac53f3840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59ba expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787367503.005869:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1787367503.007046:0:6718:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1408us 00010000:00010000:1.0:1787367503.076673:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.076697:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.076709:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.076725:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.076731:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.076737:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077633:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077655:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077664:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367503.077745:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787367503.077750:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367503.077837:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077850:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077857:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077863:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077868:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367503.077872:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077878:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077890:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18000) 00010000:00010000:1.0:1787367503.077894:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367503.077898:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077916:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077928:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077934:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077939:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077944:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367503.077947:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077952:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077961:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e8f86d97a00) 00010000:00010000:1.0:1787367503.077963:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367503.077966:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.077972:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f384e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.078009:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048400/0xcbf1f1bac53f3840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ba expref: 8 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.078026:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ba expref: 7 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.078120:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:1.0:1787367503.078123:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787367503.078125:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fe00, rc 0) 00000100:00100000:1.0:1787367503.078387:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9701:x1874190425671168:12345-192.168.204.23@tcp:101:touch.500 Request processed in 72847us (73044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367503.078396:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1787367503.082920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.083136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671424 00000100:00100000:0.0:1787367503.083146:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671424 00000100:00100000:0.0:1787367503.083256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1787367503.083266:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:9701:x1874190425671424:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:0.0:1787367503.083287:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367503.083339:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f385c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59c1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083675:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083685:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083750:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083768:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.083774:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367503.084627:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787367503.084915:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084928:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084937:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084970:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084978:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084984:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.084990:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367503.084995:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.085003:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.085025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:0.0:1787367503.085028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367503.085032:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.085038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3863 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367503.085054:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003090a33f reply state 0000000094c38b1c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367503.085063:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787367503.085096:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f385c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c1 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.085112:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c1 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.085118:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18e00) 00010000:00010000:0.0:1787367503.085121:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367503.085123:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599200, rc 0) 00000100:00100000:0.0:1787367503.085266:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:9701:x1874190425671424:12345-192.168.204.23@tcp:101:touch.500 Request processed in 2000us (2355us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787367503.085276:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:3.0:1787367503.097556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1787367503.097631:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097644:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097653:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097675:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.097680:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097688:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097704:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9e8f83c18700) 00010000:00010000:2.0:1787367503.097707:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.097711:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.097718:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f386a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367503.097810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671680 00000100:00100000:0.0:1787367503.097820:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671680 00000100:00100000:0.0:1787367503.097869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1787367503.097879:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:9701:x1874190425671680:12345-192.168.204.23@tcp:36:touch.500 00010000:00010000:0.0:1787367503.097948:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367503.097966:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c1 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.097977:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18e00) 00010000:00010000:0.0:1787367503.097984:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367503.098027:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.098041:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.098050:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367503.098229:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007863ffcd reply state 0000000097fb798b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367503.098418:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367503.099156:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:9701:x1874190425671680:12345-192.168.204.23@tcp:36:touch.500 Request processed in 1273us (1603us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787367503.099165:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00010000:00010000:2.0:1787367503.120899:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120917:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120925:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120931:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.120935:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120942:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120983:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18200) 00010000:00010000:2.0:1787367503.120985:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.120990:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.120996:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f387f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367503.122952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.123453:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671808 00000100:00100000:0.0:1787367503.123463:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671808 00000100:00100000:0.0:1787367503.123520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:0.0:1787367503.123530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:9701:x1874190425671808:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:0.0:1787367503.123555:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367503.123581:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3886 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59c8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.123668:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c8 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.123684:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c8 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.123704:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18e00) 00010000:00010000:0.0:1787367503.123707:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367503.123710:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599200, rc 0) 00000100:00100000:0.0:1787367503.123783:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:9701:x1874190425671808:12345-192.168.204.23@tcp:101:touch.500 Request processed in 254us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367503.123790:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:0.0:1787367503.128676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367503.128726:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425671936 00000100:00100000:3.0:1787367503.128736:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425671936 00000100:00100000:3.0:1787367503.128790:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1787367503.128799:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874190425671936:12345-192.168.204.23@tcp:8:touch.500 00010000:00080000:3.0:1787367503.128849:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:3.0:1787367503.128884:0:6695:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f388d 00002000:00100000:3.0:1787367503.128897:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3/ffff9e8fbf484000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787367503.128907:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787367503.129387:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787367503.129420:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf480800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367503.129505:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425671936:12345-192.168.204.23@tcp:8:touch.500 Request processed in 705us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367503.129515:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1787367503.144744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367503.144892:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425672064 00000100:00100000:2.0:1787367503.144903:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425672064 00000100:00100000:2.0:1787367503.145016:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1787367503.145027:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:0:x1874190425672064:12345-192.168.204.23@tcp:2:touch.500 00000100:00080000:1.0:1787367503.145591:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787367503.172108:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787367503.172127:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000100:00100000:2.0:1787367503.172677:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:0:x1874190425672064:12345-192.168.204.23@tcp:2:touch.500 Request processed in 27647us (27937us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787367503.172689:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1787367503.176646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.176778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425672320 00000100:00100000:0.0:1787367503.176788:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425672320 00000100:00100000:0.0:1787367503.176847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1787367503.176858:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:9701:x1874190425672320:12345-192.168.204.23@tcp:35:touch.500 00000100:00100000:0.0:1787367503.178275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:9701:x1874190425672320:12345-192.168.204.23@tcp:35:touch.500 Request processed in 1409us (1628us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787367503.178287:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1787367503.196320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367503.196550:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425672448 00000100:00100000:1.0:1787367503.196560:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425672448 00000100:00100000:1.0:1787367503.197267:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1787367503.197279:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:9702:x1874190425672448:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1787367503.197304:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367503.197325:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f400/0xcbf1f1bac53f3894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59cf expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198700:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198722:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198753:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367503.198818:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787367503.198822:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367503.198879:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198913:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f400/0xcbf1f1bac53f3894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59cf expref: 13 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198932:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59cf expref: 12 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.198939:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:0.0:1787367503.198942:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367503.198945:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e200, rc 0) 00000100:00100000:0.0:1787367503.199019:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:9702:x1874190425672448:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1741us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367503.199028:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1787367503.207356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.207418:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425672704 00000100:00100000:0.0:1787367503.207430:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425672704 00000100:00100000:0.0:1787367503.207493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1787367503.207504:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:9702:x1874190425672704:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:0.0:1787367503.207523:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367503.207556:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f38a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367503.207690:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787367503.209920:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f38a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59d6 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.209942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18000) 00010000:00010000:0.0:1787367503.209946:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367503.209951:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f38a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59d6 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.209970:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599000, rc 0) 00000100:00100000:0.0:1787367503.210049:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:9702:x1874190425672704:12345-192.168.204.23@tcp:101:rm.0 Request processed in 2546us (2701us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787367503.210058:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1787367503.217110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367503.217328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425672832 00000100:00100000:2.0:1787367503.217338:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425672832 00000100:00100000:2.0:1787367503.217423:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:2.0:1787367503.217434:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:9702:x1874190425672832:12345-192.168.204.23@tcp:37:rm.0 00000100:00100000:3.0:1787367503.229864:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:9702:x1874190425672832:12345-192.168.204.23@tcp:37:rm.0 Request processed in 12421us (12753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367503.229879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367503.245280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.245325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425673088 00000100:00100000:0.0:1787367503.245336:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425673088 00000100:00100000:0.0:1787367503.245390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1787367503.245399:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:9702:x1874190425673088:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:0.0:1787367503.245645:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:9702:x1874190425673088:12345-192.168.204.23@tcp:35:rm.0 Request processed in 246us (374us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787367503.245653:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1787367503.256290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367503.256351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425673344 00000100:00100000:1.0:1787367503.256364:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425673344 00000100:00100000:1.0:1787367503.256427:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:1.0:1787367503.256438:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:9702:x1874190425673344:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1787367503.256463:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367503.256484:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f38b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59dd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.256625:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f38b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.256640:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f38b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.256651:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f38b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367503.256663:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787367503.256795:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f38b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59dd expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.256813:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f38b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59dd expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.256822:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:1.0:1787367503.256838:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367503.256842:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e800, rc 0) 00000100:00100000:1.0:1787367503.256909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425673344:12345-192.168.204.23@tcp:101:rm.0 Request processed in 473us (627us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787367503.256916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1787367503.262413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367503.262560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425673472 00000100:00100000:0.0:1787367503.262570:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425673472 00000100:00100000:0.0:1787367503.262624:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:0.0:1787367503.262634:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425673472:12345-192.168.204.23@tcp:41:rm.0 00000004:00000024:0.0:1787367503.262714:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787367503.262788:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425673472:12345-192.168.204.23@tcp:41:rm.0 Request processed in 155us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367503.262796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:0.0:1787367503.273764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367503.274248:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425673600 00000100:00100000:2.0:1787367503.274260:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425673600 00000100:00100000:2.0:1787367503.274336:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1787367503.274357:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425673600:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1787367503.274382:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367503.274405:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f38c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59e4 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274495:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274510:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274521:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274539:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274545:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274552:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274661:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274670:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274676:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367503.274703:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787367503.274707:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367503.274727:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274749:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274757:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274763:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274768:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274775:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.274779:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274786:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274797:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:2.0:1787367503.274800:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.274804:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274810:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496a00/0xcbf1f1bac53f38cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274823:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274829:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274841:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274846:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.274848:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274855:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274863:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367503.274866:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.274869:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274875:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f38d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274906:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497400/0xcbf1f1bac53f38c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59e4 expref: 18 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274921:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59e4 expref: 17 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.274928:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18e00) 00010000:00010000:2.0:1787367503.274929:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367503.274932:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496e00, rc 0) 00000100:00100000:2.0:1787367503.275003:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:9702:x1874190425673600:12345-192.168.204.23@tcp:101:rm.0 Request processed in 658us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367503.275021:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:3.0:1787367503.286321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367503.286383:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425673856 00000100:00100000:2.0:1787367503.286393:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425673856 00000100:00100000:2.0:1787367503.286460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:2.0:1787367503.286472:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:9702:x1874190425673856:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:2.0:1787367503.286527:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787367503.286556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496e00/0xcbf1f1bac53f38da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59e4 expref: 17 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286581:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f3886 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59c8 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f83c18e00) 00010000:00010000:2.0:1787367503.286610:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f389b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59cf expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286619:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:2.0:1787367503.286622:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367503.286663:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286677:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286687:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286701:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286716:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286723:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286846:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286855:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.286861:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367503.287642:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787367503.287655:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308563461570ns, next at 309563459333ns, rc = 0 00010000:00010000:2.0:1787367503.287712:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287724:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287733:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287741:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287747:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287762:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287780:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367503.287800:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287806:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287812:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287818:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.287822:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287829:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287840:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367503.287843:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787367503.287847:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287852:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f38ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287867:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287874:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287886:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287892:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.287895:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287902:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287909:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:2.0:1787367503.287912:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.287915:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.287921:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367503.287930:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040d96f4c reply state 00000000f345b8bf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367503.287939:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367503.288027:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425673856:12345-192.168.204.23@tcp:36:rm.0 Request processed in 1555us (1726us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787367503.288035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00010000:00010000:3.0:1787367503.289984:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367503.290000:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367503.290010:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367503.290015:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367503.290024:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367503.290070:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:3.0:1787367503.290073:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367503.290078:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367503.290084:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f38f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367503.290105:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367503.290107:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367503.290109:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367503.293112:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293529:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293555:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293562:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.293568:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293576:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293591:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367503.293595:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.293600:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.293605:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f38e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367503.302329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367503.302403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674112 00000100:00100000:1.0:1787367503.302413:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674112 00000100:00100000:1.0:1787367503.302474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367503.302485:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:9702:x1874190425674112:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:1.0:1787367503.302750:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425674112:12345-192.168.204.23@tcp:35:rm.0 Request processed in 266us (429us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787367503.302771:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367503.311266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367503.311473:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674368 00000100:00100000:2.0:1787367503.311483:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674368 00000100:00100000:2.0:1787367503.311538:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1787367503.311547:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:9702:x1874190425674368:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:2.0:1787367503.311606:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787367503.311634:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f38b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59dd expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311655:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ba expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311684:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:2.0:1787367503.311702:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fc2048c00/0xcbf1f1bac53f3816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59ac expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311713:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18000) 00010000:00010000:2.0:1787367503.311720:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367503.311747:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311759:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311768:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311782:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311789:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.311795:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.312107:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.312116:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.312133:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367503.312976:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787367503.312993:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313002:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313008:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313014:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.313018:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313026:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313039:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367503.313042:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787367503.313046:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313052:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f390b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313075:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313081:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313093:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313098:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367503.313101:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313107:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313116:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367503.313118:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367503.313121:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367503.313127:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f38fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367503.313140:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068ac940b reply state 00000000d50cb889 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367503.313741:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367503.313841:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:9702:x1874190425674368:12345-192.168.204.23@tcp:36:rm.0 Request processed in 2291us (2582us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787367503.313850:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00010000:00010000:1.0:1787367503.315914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315929:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315935:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315940:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367503.315945:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315952:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315969:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367503.315972:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367503.315976:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367503.315981:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3904 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367503.491461:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367504.519159:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367504.963602:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367504.963643:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446678016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367504.963748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367504.964068:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678016 00000100:00100000:2.0:1787367504.964080:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678016 00000100:00100000:2.0:1787367504.964249:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367504.964261:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446678016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367504.964325:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367504.964395:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446678016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367504.964403:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787367504.964459:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59d180 x1874190446678016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367504.964483:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446678016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367504.964679:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446678400:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.964719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367504.964745:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367504.964750:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446678272:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.964774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367504.964804:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446678528:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.964847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367504.964870:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787367504.964876:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446678144:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.964912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367504.964938:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446678656:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.964963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367504.964993:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678528 00000100:00100000:0.0:1787367504.964998:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678528 00000100:00100000:2.0:1787367504.965059:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678400 00000100:00100000:2.0:1787367504.965063:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678400 00000100:00080000:1.0:1787367504.965630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367504.965644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367504.965647:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367504.965662:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678272 00000100:00100000:1.0:1787367504.965667:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678272 00000100:00100000:1.0:1787367504.965712:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678656 00000100:00100000:1.0:1787367504.965716:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678656 00000100:00100000:1.0:1787367504.965743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787367504.965757:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446678272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367504.965841:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446678272:12345-0@lo:400:kworker.0 Request processed in 86us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367504.965849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787367504.965869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367504.965876:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446678656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367504.965911:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446678656:12345-0@lo:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367504.965918:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787367504.965957:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446678272:0@lo:400:kworker.0 00000100:00100000:1.0:1787367504.965988:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446678656:0@lo:400:kworker.0 00000100:00080000:1.0:1787367504.966001:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367504.966407:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787367504.966418:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446678528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.966470:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446678528:12345-0@lo:400:kworker.0 Request processed in 55us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367504.966477:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787367504.966657:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f9080ca80 x1874190446678528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367504.966670:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446678528:0@lo:400:kworker.0 00000100:00100000:2.0:1787367504.966812:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787367504.966822:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446678400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367504.967036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446678400:12345-0@lo:400:kworker.0 Request processed in 215us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367504.967042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787367504.967070:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678144 00000100:00100000:2.0:1787367504.967076:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678144 00000100:00100000:2.0:1787367504.967121:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787367504.967128:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367504.967178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446678144:12345-0@lo:400:kworker.0 Request processed in 51us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367504.967184:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787367504.967248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446678144:0@lo:400:kworker.0 00000100:00100000:0.0:1787367504.967938:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446678400:0@lo:400:kworker.0 00010000:00010000:0.0:1787367505.540746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367506.196670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367506.196718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367506.196748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367506.196793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367506.196852:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674496 00000100:00100000:2.0:1787367506.196864:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674496 00000100:00100000:2.0:1787367506.196920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 248 00000100:00100000:2.0:1787367506.196932:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425674496:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367506.197022:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425674496:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367506.197031:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 248 00000100:00100000:2.0:1787367506.197070:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674752 00000100:00100000:2.0:1787367506.197073:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674752 00000100:00100000:2.0:1787367506.197231:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1787367506.197240:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425674752:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367506.197409:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425674752:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 170us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367506.197417:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:0.0:1787367506.197815:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674624 00000100:00100000:0.0:1787367506.197821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674624 00000100:00100000:0.0:1787367506.197863:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425674880 00000100:00100000:0.0:1787367506.197866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425674880 00000100:00100000:0.0:1787367506.197890:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:0.0:1787367506.197897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2359:x1874190425674624:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367506.197941:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2359:x1874190425674624:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 45us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367506.197949:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:0.0:1787367506.197962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00100000:0.0:1787367506.197968:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425674880:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367506.197992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425674880:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 24us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367506.197998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00080000:2.0:1787367506.198340:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367506.198348:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367506.572460:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367507.012133:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1787367507.012222:0:7003:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312288028448ns, next at 313287995728ns, rc = 0 00000100:00100000:0.0:1787367507.018409:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446678784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367507.018524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367507.018771:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678784 00000100:00100000:2.0:1787367507.018783:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678784 00000100:00100000:2.0:1787367507.018870:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367507.018881:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446678784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367507.018942:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367507.019028:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446678784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367507.019036:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787367507.019691:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014e680 x1874190446678784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367507.019720:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446678784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787367507.021443:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787367507.588096:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367508.056975:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1787367508.136314:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000004:00080000:0.0:1787367508.136351:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787367508.136365:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1787367508.136375:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787367508.136383:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787367508.136794:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367508.136837:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446678912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787367508.136927:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367508.137837:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446678912 00000100:00100000:0.0:1787367508.137853:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446678912 00000100:00100000:0.0:1787367508.137948:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787367508.137960:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446678912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787367508.138003:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787367508.138053:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a89104f, atime: 0x6a89104f, ctime: 0x6a89104f, blocks: 0x1 00010000:00010000:0.0:1787367508.138063:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.138094:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1787367508.138100:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367508.138108:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.138131:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.138144:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.138154:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.138179:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367508.139566:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446678912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1600us (2631us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787367508.139580:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787367508.139632:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367508.139640:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.139664:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599c00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367508.139669:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.139680:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.139705:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.139714:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f3912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367508.139741:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367508.139743:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367508.139745:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787367508.140881:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fa014e680/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787367508.140897:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446678912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787367508.612465:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787367508.614326:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:2.0:1787367509.176491:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd904e6a30 20000000:00000080:2.0:1787367509.176523:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fbf8fec00 uarg=0000000000000000 20000000:01000000:2.0:1787367509.176574:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787367509.176583:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787367509.176593:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787367509.177987:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787367509.178621:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787367509.188642:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787367509.188710:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787367509.188810:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787367509.188832:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367509.188859:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188885:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188895:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188903:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188911:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188918:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188927:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.188980:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.189010:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367509.189029:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679040:0@lo:104: 00000100:00100000:2.0:1787367509.189129:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367509.189252:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.189261:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367509.189269:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679168:0@lo:104: 00000100:00100000:2.0:1787367509.189294:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367509.189320:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367509.189327:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367509.189335:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679296:0@lo:104: 00000100:00100000:2.0:1787367509.189358:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367509.189409:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787367509.189425:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679040 00000100:00100000:2.0:1787367509.189433:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679040 00000100:00100000:2.0:1787367509.189480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679168 00000100:00100000:2.0:1787367509.189483:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679168 00000100:00100000:2.0:1787367509.189495:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679296 00000100:00100000:2.0:1787367509.189497:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679296 00000100:00100000:2.0:1787367509.189514:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367509.189532:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+5:11667:x1874190446679040:12345-0@lo:104: 00010000:00010000:2.0:1787367509.189548:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.190512:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787367509.190556:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+5:11667:x1874190446679168:12345-0@lo:104: 00010000:00010000:3.0:1787367509.190575:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190678:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787367509.190684:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+5:11667:x1874190446679168:12345-0@lo:104: Request processed in 152us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367509.190692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787367509.190722:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787367509.190730:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:11667:x1874190446679296:12345-0@lo:104: 00010000:00010000:3.0:1787367509.190754:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190804:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787367509.190810:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3464c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89d46cbb-4841-4af3-a474-32a0415d3217+4:11667:x1874190446679296:12345-0@lo:104: Request processed in 81us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367509.190816:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787367509.190840:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367509.190846:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190854:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367509.190859:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190870:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367509.190879:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367509.190885:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367509.190933:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190940:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367509.190967:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190973:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f000/0xcbf1f1bac53f37d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37d7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.190995:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367509.190998:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.191004:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2048e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367509.191006:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.191013:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367509.191019:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367509.191032:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367509.191055:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.191061:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367509.191069:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.191075:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2048e00/0xcbf1f1bac53f37c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.191091:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367509.191093:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367509.191094:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367509.191101:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367509.191124:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446679424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367509.191169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367509.191253:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367509.191260:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446679552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367509.191284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367509.191324:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679424 00000100:00100000:3.0:1787367509.194872:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679424 00010000:00010000:3.0:1787367509.194962:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 19 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.195022:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679552 00000100:00100000:3.0:1787367509.195028:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679552 00010000:00010000:3.0:1787367509.195043:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 20 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.195082:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787367509.195093:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+20:3310:x1874190446679424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367509.195113:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367509.195120:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 20 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.195133:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 20 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.195158:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367509.195274:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+20:3310:x1874190446679424:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367509.195282:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787367509.195302:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367509.195309:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446679552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367509.195348:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367509.195353:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 19 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.195361:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 19 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.195371:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367509.195395:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446679552:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367509.195402:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367509.195473:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446679552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367509.195485:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446679424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367509.196039:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.196068:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 12 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.196084:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679680:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367509.196311:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.196321:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 12 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.196342:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679808:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367509.196385:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8540 going to sleep for 11 seconds 00010000:00010000:3.0:1787367509.196410:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2048a00/0xcbf1f1bac53f37d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f37d0 expref: 18 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.196428:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679168:0@lo:104: 00010000:00010000:3.0:1787367509.196441:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2048600/0xcbf1f1bac53f37c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f37c2 expref: 17 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.196450:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679296:0@lo:104: 00010000:00010000:2.0:1787367509.197162:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367509.197175:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89d46cbb-4841-4af3-a474-32a0415d3217+3:11667:x1874190446679040:12345-0@lo:104: Request processed in 7642us (8044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367509.197187:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787367509.197462:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367509.197473:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.197484:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367509.197489:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.197500:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367509.197509:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367509.197518:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367509.197886:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.197894:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367509.197928:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.197936:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fa00/0xcbf1f1bac53f37de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f37e5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.197976:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367509.197978:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367509.197980:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367509.197991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367509.198011:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446679936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367509.198077:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367509.198122:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446679936 00000100:00100000:1.0:1787367509.198129:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446679936 00010000:00010000:1.0:1787367509.198165:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 17 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.198445:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679040:0@lo:104: 00000100:00100000:1.0:1787367509.198633:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787367509.198645:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+17:3313:x1874190446679936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367509.198661:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367509.198668:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 17 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.198680:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 17 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.198698:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2049000/0xcbf1f1bac53f37e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f37de expref: 17 pid: 5836 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.198717:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367509.198765:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92393050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3313:x1874190446679936:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367509.198772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367509.200672:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446679936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367509.211120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367509.211289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367509.211476:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675008 00000100:00100000:1.0:1787367509.211517:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675008 00010000:00010000:1.0:1787367509.211573:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 13 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367509.211619:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675136 00000100:00100000:1.0:1787367509.211622:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675136 00010000:00010000:1.0:1787367509.211637:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 14 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.211732:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679680:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367509.211746:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1874190446679808:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367509.211799:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367509.212772:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1787367509.212797:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+14:2357:x1874190425675008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367509.212825:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367509.212835:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 14 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367509.212852:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 14 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.212877:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:1.0:1787367509.212879:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f37bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d599e expref: 14 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367509.212893:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425675136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367509.212906:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367509.212906:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367509.212986:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 13 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213002:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 13 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367509.213002:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425675008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 214us (1906us total) trans 0 rc 0/0 00010000:00010000:3.0:1787367509.213023:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2049400/0xcbf1f1bac53f37b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5997 expref: 13 pid: 5836 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213073:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213083:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213171:0:7633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213180:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213229:0:7633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213240:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213247:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367509.213252:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213261:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213277:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.213290:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367509.213321:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:2357:x1874190425675136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 432us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367509.213821:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1787367509.216446:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:3.0:1787367509.216604:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.216620:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.216629:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3919 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367509.637568:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367510.084387:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367510.084423:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446680064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367510.084526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367510.084861:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680064 00000100:00100000:2.0:1787367510.084873:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680064 00000100:00100000:2.0:1787367510.084958:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367510.084971:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446680064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367510.085019:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367510.085105:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446680064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.085114:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787367510.085307:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787367510.085373:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3c81c00 x1874190446680064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367510.085398:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446680064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367510.086623:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446680448:0@lo:400:kworker.0 00000100:00100000:1.0:1787367510.086714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367510.086773:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367510.086779:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446680576:0@lo:400:kworker.0 00000100:00100000:1.0:1787367510.086810:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.086906:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446680192:0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.086949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.086992:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446680704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087017:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.087050:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367510.087056:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446680320:0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087078:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.087117:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680448 00000100:00100000:3.0:1787367510.087127:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680448 00000100:00100000:1.0:1787367510.087144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680192 00000100:00100000:1.0:1787367510.087148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680192 00000100:00100000:1.0:1787367510.087222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787367510.087229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680704 00000100:00100000:1.0:1787367510.087231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:3310:x1874190446680192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087233:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680704 00000100:00100000:3.0:1787367510.087248:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680320 00000100:00100000:3.0:1787367510.087250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680320 00000100:00100000:3.0:1787367510.087264:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787367510.087269:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446680448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367510.087294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+16:3310:x1874190446680192:12345-0@lo:400:kworker.0 Request processed in 64us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.087303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787367510.087305:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446680448:12345-0@lo:400:kworker.0 Request processed in 37us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.087333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787367510.087344:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787367510.087350:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446680704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367510.087359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787367510.087366:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446680320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087378:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446680704:12345-0@lo:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.087384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787367510.087391:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446680320:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.087397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787367510.087419:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367510.087424:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446680320:0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446680192:0@lo:400:kworker.0 00000100:00100000:3.0:1787367510.087443:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446680704:0@lo:400:kworker.0 00000100:00100000:1.0:1787367510.087443:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446680448:0@lo:400:kworker.0 00000100:00100000:2.0:1787367510.087596:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680576 00000100:00100000:2.0:1787367510.087601:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680576 00000100:00100000:2.0:1787367510.087659:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787367510.087667:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446680576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367510.087721:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446680576:12345-0@lo:400:kworker.0 Request processed in 56us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.087727:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787367510.087832:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787367510.087841:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fa014e680, transno 4294967300 00000100:00100000:0.0:1787367510.087861:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446680576:0@lo:400:kworker.0 00000100:00080000:1.0:1787367510.088169:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367510.659638:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787367510.787432:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367510.787444:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbf411800 from 7 10000000:01000000:3.0:1787367510.787451:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367510.787530:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.787544:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.787556:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367510.787588:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446680832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.787682:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.787748:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275540 going to sleep for 11 seconds 00000100:00100000:2.0:1787367510.787891:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680832 00000100:00100000:2.0:1787367510.787902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680832 00000100:00100000:2.0:1787367510.787983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787367510.788005:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+16:5838:x1874190446680832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367510.788051:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367510.788070:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a74c00/0xcbf1f1bac53f3927 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f3920 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367510.788098:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a74c00/0xcbf1f1bac53f3927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3920 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367510.788110:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a74c00/0xcbf1f1bac53f3927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f3920 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367510.788121:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74c00, rc 0) 00000100:00100000:2.0:1787367510.788186:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446680832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.788221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787367510.788437:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446680832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367510.788464:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.788486:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367510.788552:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.788586:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.788618:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275540 going to sleep for 11 seconds 00000100:00100000:2.0:1787367510.789051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446680960 00000100:00100000:2.0:1787367510.789058:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446680960 00000100:00100000:2.0:1787367510.789106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787367510.789115:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446680960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367510.789503:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446680960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.789511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787367510.790275:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446680960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.790337:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.790401:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.790444:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367510.790584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681088 00000100:00100000:1.0:1787367510.790592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681088 00000100:00100000:1.0:1787367510.790644:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787367510.790663:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446681088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367510.790889:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446681088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.790897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787367510.791387:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367510.795603:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11680:1874190446681216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367510.795738:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367510.795804:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.795877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681216 00000100:00100000:0.0:1787367510.795888:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681216 00000100:00100000:0.0:1787367510.795958:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787367510.795979:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:11680:x1874190446681216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367510.796361:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+17:11680:x1874190446681216:12345-0@lo:502:llog_process_th.0 Request processed in 383us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.796370:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787367510.796764:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11680:1874190446681216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367510.796805:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367510.796817:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367510.796826:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367510.796836:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8fbf411800 00000020:00000080:2.0:1787367510.796839:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367510.796959:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11680:1874190446681344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367510.797007:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367510.797057:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.800259:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681344 00000100:00100000:0.0:1787367510.800278:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681344 00000100:00100000:0.0:1787367510.800364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787367510.800376:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:11680:x1874190446681344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367510.800745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+17:11680:x1874190446681344:12345-0@lo:502:llog_process_th.0 Request processed in 370us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.800755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787367510.801169:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11680:1874190446681344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787367510.801246:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367510.801257:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367510.801259:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787367510.801264:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787367510.803431:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787367510.803480:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367510.803498:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.803514:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367510.803532:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787367510.803536:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fb88be800 from 7 10000000:01000000:0.0:1787367510.803540:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367510.803603:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.803613:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.803625:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367510.803680:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.803777:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.803848:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367510.804015:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681472 00000100:00100000:1.0:1787367510.804035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681472 00000100:00100000:1.0:1787367510.804092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787367510.804102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+17:5838:x1874190446681472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367510.804121:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367510.804140:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5f400/0xcbf1f1bac53f3935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f392e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367510.804186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5f400/0xcbf1f1bac53f3935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f392e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367510.804216:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5f400/0xcbf1f1bac53f3935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f392e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367510.804226:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f400, rc 0) 00000100:00100000:1.0:1787367510.804279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9477ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446681472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.804286:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787367510.809716:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367510.809760:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.809776:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367510.809894:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.809988:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.810056:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367510.810394:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681600 00000100:00100000:1.0:1787367510.810418:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681600 00000100:00100000:1.0:1787367510.810488:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787367510.810500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446681600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367510.810882:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446681600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.810891:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787367510.821005:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.821121:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.821306:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.821356:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367510.822703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681728 00000100:00100000:2.0:1787367510.822718:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681728 00000100:00100000:2.0:1787367510.822813:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787367510.822825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446681728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367510.823153:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446681728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 329us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.823172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787367510.823519:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446681728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.824761:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11682:1874190446681856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367510.824876:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.824928:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367510.825235:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681856 00000100:00100000:2.0:1787367510.825245:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681856 00000100:00100000:2.0:1787367510.825314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787367510.825325:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:11682:x1874190446681856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367510.825617:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+18:11682:x1874190446681856:12345-0@lo:502:llog_process_th.0 Request processed in 292us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367510.825627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787367510.825861:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11682:1874190446681856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367510.825902:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367510.825915:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367510.825918:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787367510.825926:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8fb88be800 00000020:00000080:3.0:1787367510.825929:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367510.826041:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11682:1874190446681984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367510.826089:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.826118:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.826224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446681984 00000100:00100000:0.0:1787367510.826230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446681984 00000100:00100000:0.0:1787367510.826264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787367510.826272:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:11682:x1874190446681984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367510.826439:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:11682:x1874190446681984:12345-0@lo:502:llog_process_th.0 Request processed in 167us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.826459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787367510.827354:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11682:1874190446681984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367510.827421:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367510.827432:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367510.827435:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787367510.827440:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787367510.829341:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787367510.829387:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367510.829402:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829417:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367510.829431:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787367510.829434:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92200800 from 7 10000000:01000000:0.0:1787367510.829437:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367510.829493:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829501:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829515:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367510.829545:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.829635:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.829686:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.829718:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682112 00000100:00100000:0.0:1787367510.829726:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682112 00000100:00100000:0.0:1787367510.829782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787367510.829793:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+18:5838:x1874190446682112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367510.829811:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367510.829847:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f3943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f393c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829876:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f3943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f393c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829889:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f3943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f393c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.829899:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598e00, rc 0) 00000100:00100000:0.0:1787367510.829943:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446682112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.829952:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787367510.830008:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367510.830039:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367510.830049:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367510.830104:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.830130:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.830149:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.834364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682240 00000100:00100000:0.0:1787367510.834387:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682240 00000100:00100000:0.0:1787367510.834468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787367510.834480:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446682240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.834915:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446682240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 436us (4782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.834932:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787367510.835026:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.835097:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.835155:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367510.835223:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367510.835242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682368 00000100:00100000:0.0:1787367510.835246:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682368 00000100:00100000:0.0:1787367510.835274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787367510.835281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446682368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787367510.835460:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:5838:x1874190446682368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367510.835466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787367510.835506:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3902d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89d46cbb-4841-4af3-a474-32a0415d3217:5838:1874190446682368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.840260:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11684:1874190446682496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367510.840375:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367510.840437:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367510.840858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682496 00000100:00100000:1.0:1787367510.840868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682496 00000100:00100000:1.0:1787367510.840943:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787367510.840956:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:11684:x1874190446682496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367510.841751:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:11684:x1874190446682496:12345-0@lo:502:llog_process_th.0 Request processed in 795us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.841763:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787367510.851724:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11684:1874190446682496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367510.851934:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367510.851956:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367510.851958:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367510.851969:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8f92200800 00000020:00000080:2.0:1787367510.851972:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787367510.852128:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11684:1874190446682624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367510.852289:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367510.852353:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787367510.852528:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682624 00000100:00100000:1.0:1787367510.852538:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682624 00000100:00100000:1.0:1787367510.852608:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787367510.852620:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:11684:x1874190446682624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367510.852922:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:11684:x1874190446682624:12345-0@lo:502:llog_process_th.0 Request processed in 303us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.852931:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787367510.853421:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3813b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89d46cbb-4841-4af3-a474-32a0415d3217:11684:1874190446682624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367510.853459:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367510.853467:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367510.853469:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787367510.853474:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787367510.853701:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787367510.853723:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787367510.853735:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367510.853748:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367510.884125:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787367510.915467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367510.915525:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675264 00000100:00100000:3.0:1787367510.915539:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675264 00000100:00100000:3.0:1787367510.915608:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 265 00000100:00100000:3.0:1787367510.915620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:5599:x1874190425675264:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367510.915643:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367510.915668:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e800/0xcbf1f1bac53f394a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d59eb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.915708:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e800/0xcbf1f1bac53f394a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59eb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.915721:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357e800/0xcbf1f1bac53f394a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59eb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.915732:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e800, rc 0) 00000100:00100000:3.0:1787367510.915817:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675264:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 199us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.915824:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 265 00000100:00100000:3.0:1787367510.934495:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.934620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675392 00000100:00100000:1.0:1787367510.934632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675392 00000100:00100000:1.0:1787367510.934699:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 266 00000100:00100000:1.0:1787367510.934709:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675392:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367510.935102:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675392:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 392us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.935112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 266 00000100:00100000:3.0:1787367510.942484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.942873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675520 00000100:00100000:1.0:1787367510.942889:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675520 00000100:00100000:1.0:1787367510.942983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 267 00000100:00100000:1.0:1787367510.942995:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675520:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367510.943347:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675520:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 352us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.943357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 267 00000100:00100000:1.0:1787367510.950747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367510.950994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675648 00000100:00100000:3.0:1787367510.951008:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675648 00000100:00100000:3.0:1787367510.951093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 268 00000100:00100000:3.0:1787367510.951106:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:9973:x1874190425675648:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367510.951606:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:9973:x1874190425675648:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 501us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.951615:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 268 00000100:00100000:3.0:1787367510.960501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.960614:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675776 00000100:00100000:1.0:1787367510.960627:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675776 00000100:00100000:1.0:1787367510.960702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 269 00000100:00100000:1.0:1787367510.960715:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:9973:x1874190425675776:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367510.961604:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:9973:x1874190425675776:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 885us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.961616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 269 00000100:00100000:0.0:1787367510.971451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367510.973481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425675904 00000100:00100000:3.0:1787367510.973503:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425675904 00000100:00100000:3.0:1787367510.973625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 270 00000100:00100000:3.0:1787367510.973637:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:5599:x1874190425675904:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367510.973660:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367510.973683:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f3951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d59f2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.973725:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f3951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.973739:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f3951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367510.973749:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f600, rc 0) 00000100:00100000:3.0:1787367510.973848:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425675904:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 213us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.973892:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 270 00000100:00100000:0.0:1787367510.983044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.983147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676032 00000100:00100000:1.0:1787367510.983161:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676032 00000100:00100000:1.0:1787367510.983273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 271 00000100:00100000:1.0:1787367510.983284:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425676032:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367510.983647:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425676032:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 363us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.983657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 271 00000100:00100000:2.0:1787367510.988037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367510.988175:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676160 00000100:00100000:3.0:1787367510.988234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676160 00000100:00100000:3.0:1787367510.988302:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 272 00000100:00100000:3.0:1787367510.988313:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425676160:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367510.988600:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:5599:x1874190425676160:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 287us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367510.988609:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 272 00000100:00100000:3.0:1787367510.992524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.993693:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676288 00000100:00100000:1.0:1787367510.993711:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676288 00000100:00100000:1.0:1787367510.993797:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 273 00000100:00100000:1.0:1787367510.993809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:9976:x1874190425676288:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367510.994167:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:9976:x1874190425676288:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 360us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.994177:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 273 00000100:00100000:0.0:1787367510.999047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367510.999159:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676416 00000100:00100000:1.0:1787367510.999172:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676416 00000100:00100000:1.0:1787367510.999276:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 274 00000100:00100000:1.0:1787367510.999287:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:9976:x1874190425676416:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367510.999616:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:9976:x1874190425676416:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 328us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367510.999626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 274 00000100:00100000:2.0:1787367511.300547:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367511.300589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367511.305653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367511.306351:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676672 00000100:00100000:0.0:1787367511.306365:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676672 00000100:00100000:1.0:1787367511.306441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676544 00000100:00100000:0.0:1787367511.306676:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:0.0:1787367511.306689:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425676672:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367511.306800:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425676672:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 114us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367511.306810:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1787367511.308097:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676544 00000100:00080000:2.0:1787367511.308626:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367511.308633:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367511.308928:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676800 00000100:00100000:1.0:1787367511.308937:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676800 00000100:00100000:0.0:1787367511.309034:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:0.0:1787367511.309070:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425676544:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367511.309208:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425676544:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 125us (8660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367511.309220:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:1.0:1787367511.311414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00100000:1.0:1787367511.311434:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425676800:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367511.311580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425676800:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 152us (10989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367511.311590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00080000:2.0:1787367511.311659:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787367511.684095:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367511.940923:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787367512.132537:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367512.132574:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446682752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367512.132675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367512.135119:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682752 00000100:00100000:2.0:1787367512.135141:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682752 00000100:00100000:2.0:1787367512.135289:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787367512.135302:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446682752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367512.135361:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367512.135502:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446682752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367512.135511:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787367512.135668:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446682752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787367512.135772:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367512.707522:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367513.731426:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367514.757532:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367515.203854:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446683136:0@lo:400:kworker.0 00000100:00100000:2.0:1787367515.203889:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446683264:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.203961:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367515.204037:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446682880:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.204056:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683136 00000100:00100000:3.0:1787367515.204065:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683136 00000100:00100000:0.0:1787367515.204096:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367515.204132:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787367515.204134:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446683392:0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204162:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367515.204167:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204189:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787367515.204323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446682880 00000100:00100000:1.0:1787367515.204330:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446682880 00000100:00100000:0.0:1787367515.204379:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446683008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367515.204420:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446683520:0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367515.204484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683392 00000100:00100000:0.0:1787367515.204488:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683392 00000100:00100000:0.0:1787367515.204519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683008 00000100:00100000:0.0:1787367515.204522:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683008 00000100:00100000:0.0:1787367515.204536:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787367515.204543:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446683392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204585:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446683392:12345-0@lo:400:kworker.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367515.204592:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787367515.204607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787367515.204612:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446683008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204639:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446683008:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367515.204654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1787367515.204672:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367515.204703:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446683008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.204718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446683392:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.204726:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446683136:12345-0@lo:400:kworker.0 Request processed in 580us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367515.204735:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787367515.204780:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446683136:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.204807:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446683648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367515.204834:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683520 00000100:00100000:0.0:1787367515.204839:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683520 00000100:00100000:3.0:1787367515.204844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367515.204885:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787367515.204889:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683648 00000100:00100000:0.0:1787367515.204894:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.204895:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683648 00000100:00100000:0.0:1787367515.204962:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446683520:12345-0@lo:400:kworker.0 Request processed in 71us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367515.204969:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787367515.204983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787367515.205003:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3bcf800 x1874190446683520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367515.205014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446683520:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.205087:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367515.205096:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446683648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367515.205130:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367515.205623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367515.209251:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683264 00000100:00100000:0.0:1787367515.209271:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683264 00000100:00100000:0.0:1787367515.209351:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787367515.209362:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446683264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367515.209481:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446683264:12345-0@lo:400:kworker.0 Request processed in 121us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367515.209489:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787367515.209528:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367515.209678:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787367515.209691:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367515.209795:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446682880:12345-0@lo:400:kworker.0 Request processed in 107us (5698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367515.209803:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787367515.210446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446682880:0@lo:400:kworker.0 00000100:00100000:3.0:1787367515.212695:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446683648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6727us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367515.212709:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787367515.213698:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb396680 x1874190446683648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367515.213746:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446683648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367515.215686:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446683264:0@lo:400:kworker.0 00010000:00010000:3.0:1787367515.779523:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367516.420713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367516.420761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367516.420794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367516.420828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367516.420860:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677184 00000100:00100000:0.0:1787367516.420868:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677184 00000100:00100000:0.0:1787367516.420940:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:0.0:1787367516.420950:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677184:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367516.421023:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677184:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367516.421031:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00080000:0.0:1787367516.421141:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367516.421244:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425676928 00000100:00100000:1.0:1787367516.421249:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425676928 00000100:00100000:1.0:1787367516.421287:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 276 00000100:00100000:1.0:1787367516.421295:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425676928:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367516.421347:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425676928:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 53us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367516.421354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 276 00000100:00100000:2.0:1787367516.421572:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677056 00000100:00100000:2.0:1787367516.421578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677056 00000100:00100000:2.0:1787367516.421634:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677312 00000100:00100000:2.0:1787367516.421637:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677312 00000100:00100000:2.0:1787367516.421662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1787367516.421669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677056:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367516.421709:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677056:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 40us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367516.421715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1787367516.421729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:2.0:1787367516.421735:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425677312:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367516.421757:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425677312:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367516.421763:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00080000:1.0:1787367516.421903:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367516.805926:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367517.253473:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367517.253499:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446683776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367517.253580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367517.253652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683776 00000100:00100000:3.0:1787367517.253662:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683776 00000100:00100000:3.0:1787367517.253753:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367517.253765:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446683776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367517.253804:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367517.253859:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446683776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367517.253867:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367517.253923:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446683776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787367517.254545:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787367517.828508:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367518.851968:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367519.875443:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367520.323464:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446683904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367520.323543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367520.323690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446683904 00000100:00100000:0.0:1787367520.323701:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446683904 00000100:00100000:0.0:1787367520.323776:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787367520.323786:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446683904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367520.323827:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367520.323889:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446683904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367520.323896:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787367520.324013:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787367520.324076:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbb395f80 x1874190446683904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367520.324301:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446684288:0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.324338:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367520.324364:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367520.324379:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446684160:0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.324403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367520.324432:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684288 00000100:00100000:3.0:1787367520.324436:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684288 00000100:00100000:3.0:1787367520.324469:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684160 00000100:00100000:3.0:1787367520.324472:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684160 00000100:00100000:3.0:1787367520.324489:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787367520.324495:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.324536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446684288:12345-0@lo:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367520.324543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787367520.324555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787367520.324561:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446684160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.324588:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446684160:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367520.324593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1787367520.324617:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367520.324638:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446684160:0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.324649:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446684288:0@lo:400:kworker.0 00000100:00100000:1.0:1787367520.324734:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446683904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367520.324766:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446684416:0@lo:400:kworker.0 00000100:00100000:1.0:1787367520.324798:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367520.324825:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787367520.324842:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446684032:0@lo:400:kworker.0 00000100:00100000:1.0:1787367520.324872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367520.324898:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446684544:0@lo:400:kworker.0 00000100:00100000:1.0:1787367520.324917:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367520.324940:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684032 00000100:00100000:1.0:1787367520.324944:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684032 00000100:00100000:1.0:1787367520.324973:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787367520.324980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446684032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367520.325014:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446684032:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367520.325019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787367520.325052:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446684032:0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.325899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684416 00000100:00100000:3.0:1787367520.325906:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684416 00000100:00100000:3.0:1787367520.325967:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787367520.325976:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446684416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.326101:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446684416:12345-0@lo:400:kworker.0 Request processed in 125us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367520.326108:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787367520.326164:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446684416:0@lo:400:kworker.0 00000100:00080000:1.0:1787367520.326246:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367520.326576:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684544 00000100:00100000:3.0:1787367520.326582:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684544 00000100:00100000:3.0:1787367520.326630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787367520.326637:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446684544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787367520.326677:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367520.326683:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446684544:12345-0@lo:400:kworker.0 Request processed in 47us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367520.326743:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446684544:0@lo:400:kworker.0 00000100:00100000:3.0:1787367520.326813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:1.0:1787367520.899865:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787367521.157633:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787367521.539325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367521.539396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367521.539492:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677568 00000100:00100000:3.0:1787367521.539503:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677568 00000100:00100000:3.0:1787367521.539579:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:3.0:1787367521.539591:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677568:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367521.539674:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425677568:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367521.539682:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00080000:0.0:1787367521.540230:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367521.540803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677440 00000100:00100000:2.0:1787367521.540821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677440 00000100:00100000:2.0:1787367521.540875:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 278 00000100:00100000:2.0:1787367521.540884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425677440:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367521.540942:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425677440:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 60us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367521.540955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 278 00000100:00100000:0.0:1787367521.542085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367521.542131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367521.542282:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677824 00000100:00100000:3.0:1787367521.542288:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677824 00000100:00100000:3.0:1787367521.542361:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:3.0:1787367521.542370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425677824:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367521.542428:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425677824:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 60us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367521.542435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00080000:0.0:1787367521.542644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367521.542943:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677696 00000100:00100000:2.0:1787367521.542960:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677696 00000100:00100000:2.0:1787367521.543016:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:2.0:1787367521.543034:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425677696:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367521.543104:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425677696:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 70us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367521.543112:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00080000:0.0:1787367521.543288:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367521.923492:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367522.376320:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446684672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367522.376413:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367522.376658:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684672 00000100:00100000:1.0:1787367522.376668:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684672 00000100:00100000:1.0:1787367522.376741:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367522.376753:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446684672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367522.376801:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367522.376862:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446684672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367522.376870:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787367522.376961:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446684672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787367522.378271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367522.949535:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367523.971513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367524.996626:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367525.443598:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367525.443624:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446684800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367525.443704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367525.444040:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684800 00000100:00100000:0.0:1787367525.444049:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684800 00000100:00080000:2.0:1787367525.444111:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367525.444149:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787367525.444159:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446684800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367525.444234:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367525.445042:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446684800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 881us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367525.445052:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787367525.445092:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fbf59ca80 x1874190446684800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367525.445115:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446684800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367525.445621:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446685312:0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.445670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367525.445700:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367525.445706:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446685184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.445743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367525.445776:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685312 00000100:00100000:1.0:1787367525.445782:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685312 00000100:00100000:1.0:1787367525.445825:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367525.445834:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446685312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.445908:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446685312:12345-0@lo:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367525.445915:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367525.445936:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685184 00000100:00100000:1.0:1787367525.445940:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685184 00000100:00100000:1.0:1787367525.445969:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787367525.445977:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446685184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.446012:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446685184:12345-0@lo:400:kworker.0 Request processed in 37us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367525.446018:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787367525.446047:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446685184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.446068:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446685312:0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.446591:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446684928:0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.446642:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367525.446687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446685440:0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.446714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367525.447031:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367525.447039:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446685056:0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.447069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367525.447102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685440 00000100:00100000:2.0:1787367525.447107:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685440 00000100:00100000:2.0:1787367525.447256:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685056 00000100:00100000:2.0:1787367525.447260:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685056 00000100:00100000:2.0:1787367525.447276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787367525.447282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446685440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.447327:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446685440:12345-0@lo:400:kworker.0 Request processed in 45us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367525.447334:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787367525.447350:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787367525.447367:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446685056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.447668:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446685056:12345-0@lo:400:kworker.0 Request processed in 302us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367525.447675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787367525.447696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367525.447702:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367525.447741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446685056:0@lo:400:kworker.0 00000100:00100000:2.0:1787367525.447755:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446685440:0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.448177:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446684928 00000100:00100000:1.0:1787367525.448183:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446684928 00000100:00100000:1.0:1787367525.448242:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787367525.448250:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446684928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367525.448319:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446684928:12345-0@lo:400:kworker.0 Request processed in 69us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367525.448325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787367525.448420:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446684928:0@lo:400:kworker.0 00010000:00010000:3.0:1787367526.019440:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367526.661678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367526.661742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367526.661849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425677952 00000100:00100000:2.0:1787367526.661858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425677952 00000100:00100000:2.0:1787367526.661915:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 280 00000100:00100000:2.0:1787367526.661935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425677952:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367526.662007:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425677952:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367526.662015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 280 00000100:00100000:3.0:1787367526.662238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678080 00000100:00100000:3.0:1787367526.662243:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678080 00000100:00100000:3.0:1787367526.662694:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:3.0:1787367526.662704:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425678080:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367526.662758:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425678080:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367526.662765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00080000:2.0:1787367526.663152:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367526.672613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367526.672666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367526.672772:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678208 00000100:00100000:2.0:1787367526.672783:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678208 00000100:00100000:2.0:1787367526.673542:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1787367526.673556:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2355:x1874190425678208:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:2.0:1787367526.673589:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f388d 00000100:00080000:2.0:1787367526.673599:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf480800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787367526.673638:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1787367526.675068:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367526.675420:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678336 00000100:00100000:3.0:1787367526.675431:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678336 00000100:00100000:3.0:1787367526.675522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:3.0:1787367526.675532:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425678336:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367526.675619:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425678336:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 89us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367526.675627:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00080000:0.0:1787367526.676007:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367526.676726:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+2:2355:x1874190425678208:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 3156us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367526.676739:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:1.0:1787367526.677139:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367527.045292:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367527.491859:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367527.491883:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446685568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367527.491958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367527.495034:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685568 00000100:00100000:3.0:1787367527.495047:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685568 00000100:00100000:3.0:1787367527.495113:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787367527.495123:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446685568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367527.495163:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367527.495279:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446685568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367527.495286:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787367527.498867:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367527.498955:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446685568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367528.076398:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367529.092785:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787367529.136553:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:1.0:1787367529.136564:0:6722:0:(genops.c:885:class_export_put()) final put ffff9e8fbf484000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:2.0:1787367529.136640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf484000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-OST0000 00000020:00000080:2.0:1787367529.136919:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbf480800 for lustre-OST0000 00010000:00010000:3.0:1787367530.115428:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367530.564820:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446685824:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.564915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.564967:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446686336:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.564992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.565023:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787367530.565028:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446685696:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.565055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.565075:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446686208:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.565097:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.565120:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446685952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.565143:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.565164:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367530.565169:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446686080:0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685696 00000100:00100000:0.0:1787367530.565356:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685696 00000100:00100000:0.0:1787367530.565402:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787367530.565410:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446685696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446685696:12345-0@lo:400:kworker.0 Request processed in 68us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367530.565487:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787367530.565520:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685824 00000100:00100000:0.0:1787367530.565524:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685824 00000100:00100000:0.0:1787367530.565562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686208 00000100:00100000:0.0:1787367530.565565:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686208 00000100:00100000:0.0:1787367530.565601:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446685952 00000100:00100000:0.0:1787367530.565605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446685952 00000100:00100000:0.0:1787367530.565640:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787367530.565648:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446685824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565685:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446685824:12345-0@lo:400:kworker.0 Request processed in 38us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367530.565692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787367530.565707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367530.565713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446686208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565747:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446686208:12345-0@lo:400:kworker.0 Request processed in 35us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367530.565753:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787367530.565765:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787367530.565771:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446685952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565799:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446685952:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367530.565813:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787367530.565840:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367530.565846:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446685696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367530.565864:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446686208:0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565874:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686336 00000100:00100000:0.0:1787367530.565879:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686336 00000100:00100000:1.0:1787367530.565880:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446685824:0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565917:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787367530.565924:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446686336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367530.565963:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446686336:12345-0@lo:400:kworker.0 Request processed in 40us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367530.565970:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787367530.565985:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367530.565995:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446686464:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787367530.566000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367530.566027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787367530.566030:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fba6e1500 x1874190446686336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367530.566044:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446686336:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.566222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367530.566261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446685952:0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.566284:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686080 00000100:00100000:3.0:1787367530.566288:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686080 00000100:00100000:3.0:1787367530.566370:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787367530.566377:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446686080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367530.566414:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446686080:12345-0@lo:400:kworker.0 Request processed in 38us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367530.566421:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787367530.566438:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686464 00000100:00100000:3.0:1787367530.566442:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686464 00000100:00100000:3.0:1787367530.566465:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787367530.566471:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446686464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367530.566520:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367530.566567:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446686464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367530.566574:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787367530.566686:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3bce300 x1874190446686464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367530.566702:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446686464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367530.566725:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446686080:0@lo:400:kworker.0 00000100:00080000:1.0:1787367530.567033:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367531.139450:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787367531.409258:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787367531.784543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367531.787716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367531.788101:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678592 00000100:00100000:1.0:1787367531.788131:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678592 00000100:00100000:1.0:1787367531.788270:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:1.0:1787367531.788285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425678592:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367531.788377:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425678592:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 97us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367531.788385:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:0.0:1787367531.788477:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678464 00000100:00100000:0.0:1787367531.788482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678464 00000100:00100000:0.0:1787367531.788527:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 282 00000100:00100000:0.0:1787367531.788544:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425678464:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367531.788592:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425678464:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 57us (4069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367531.788598:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 282 00000100:00080000:2.0:1787367531.788735:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367531.795713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367531.795907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678720 00000100:00100000:0.0:1787367531.795918:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678720 00000100:00100000:0.0:1787367531.796011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:0.0:1787367531.796022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425678720:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367531.796111:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425678720:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367531.796120:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00080000:2.0:1787367531.796773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367532.165528:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367532.611507:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446686592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367532.611606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367532.612077:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686592 00000100:00100000:3.0:1787367532.612086:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686592 00000100:00100000:3.0:1787367532.612167:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787367532.612178:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446686592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367532.612267:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367532.612326:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446686592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367532.612333:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787367532.612451:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367532.612796:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446686592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367533.187566:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367533.513660:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:58:51 (1787367531) 00010000:00010000:3.0:1787367534.211520:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367535.034357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367535.034600:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678848 00000100:00100000:0.0:1787367535.034610:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678848 00000100:00100000:0.0:1787367535.034704:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1787367535.034717:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:10245:x1874190425678848:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367535.034738:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367535.034777:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d59f9 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.034843:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.034859:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.034874:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367535.035097:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787367535.035102:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367535.035421:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.036496:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f9 expref: 7 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.036520:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f9 expref: 6 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.036541:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367535.036553:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367535.036558:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599200, rc 0) 00000100:00100000:0.0:1787367535.036641:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:10245:x1874190425678848:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1927us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.036651:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00080000:2.0:1787367535.036790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367535.046866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367535.050027:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425678976 00000100:00100000:0.0:1787367535.050048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425678976 00000100:00100000:0.0:1787367535.050251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1787367535.050263:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:10246:x1874190425678976:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367535.050293:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367535.050316:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a00 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050384:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050399:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050450:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.050471:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053357:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053392:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367535.053487:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787367535.053491:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367535.053586:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053599:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053604:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053611:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053617:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367535.053621:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053628:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.053665:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367535.053668:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367535.053679:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054571:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f396d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054587:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054594:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054600:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054604:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367535.054608:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054614:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054624:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e8f83c18800) 00010000:00010000:0.0:1787367535.054626:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367535.054630:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054635:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054839:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a00 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054855:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a00 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367535.054862:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18200) 00010000:00010000:0.0:1787367535.054864:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367535.054867:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598400, rc 0) 00000100:00100000:0.0:1787367535.055033:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10246:x1874190425678976:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 4771us (8177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.055047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1787367535.058342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367535.062556:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679232 00000100:00100000:1.0:1787367535.062573:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679232 00000100:00100000:1.0:1787367535.062650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:1.0:1787367535.062663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10246:x1874190425679232:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367535.062698:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367535.062726:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3982 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a07 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062817:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062832:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062842:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062918:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062926:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.062949:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065088:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f3997 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065112:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f3997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065124:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f3997 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367535.065226:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787367535.065440:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065448:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065455:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065461:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367535.065465:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065473:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065485:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18200) 00010000:00010000:1.0:1787367535.065489:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367535.065501:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3989 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065523:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065529:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065536:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065540:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367535.065552:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065559:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065566:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e8f86d97f00) 00010000:00010000:1.0:1787367535.065568:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367535.065571:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.065577:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3990 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.068415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3982 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a07 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.068465:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f3997 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a07 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367535.068475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:1.0:1787367535.068479:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367535.068483:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e200, rc 0) 00000100:00100000:1.0:1787367535.068572:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10246:x1874190425679232:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 5911us (10248us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787367535.068582:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1787367535.074267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367535.074364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679360 00000100:00100000:0.0:1787367535.074381:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679360 00000100:00100000:0.0:1787367535.074458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1787367535.074467:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10246:x1874190425679360:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787367535.074592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10246:x1874190425679360:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 126us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.074600:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:3.0:1787367535.236096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787367535.494064:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787367535.686746:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446686848:0@lo:400:kworker.0 00000100:00100000:1.0:1787367535.686853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367535.686890:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686848 00000100:00100000:3.0:1787367535.686900:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686848 00000100:00100000:1.0:1787367535.686917:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446687360:0@lo:400:kworker.0 00000100:00100000:1.0:1787367535.686944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367535.686963:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367535.686969:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787367535.686974:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446686720:0@lo:400:kworker.0 00000100:00100000:3.0:1787367535.686975:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446686848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367535.687003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367535.687023:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446687232:0@lo:400:kworker.0 00000100:00100000:3.0:1787367535.687029:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446686848:12345-0@lo:400:kworker.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367535.687036:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787367535.687045:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367535.687105:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446687104:0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.687138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367535.687161:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367535.687166:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446686976:0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.687187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367535.687275:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446686848:0@lo:400:kworker.0 00000100:00100000:1.0:1787367535.687311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686720 00000100:00100000:1.0:1787367535.687315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686720 00000100:00100000:1.0:1787367535.687346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787367535.687352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446686720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367535.687389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446686720:12345-0@lo:400:kworker.0 Request processed in 37us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367535.687412:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787367535.687450:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446686720:0@lo:400:kworker.0 00000100:00100000:3.0:1787367535.688309:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446687232 00000100:00100000:3.0:1787367535.688316:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446687232 00000100:00100000:3.0:1787367535.688364:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787367535.688373:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446687232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367535.688527:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446687232:12345-0@lo:400:kworker.0 Request processed in 155us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367535.688858:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787367535.688911:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446687232:0@lo:400:kworker.0 00000100:00080000:1.0:1787367535.692126:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367535.692305:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446687360 00000100:00100000:0.0:1787367535.692316:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446687360 00000100:00100000:0.0:1787367535.692374:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446687104 00000100:00100000:0.0:1787367535.692377:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446687104 00000100:00100000:0.0:1787367535.692609:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787367535.692621:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446687360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.692752:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446687360:12345-0@lo:400:kworker.0 Request processed in 133us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.692759:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787367535.692776:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367535.692783:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446687104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.692830:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446687104:12345-0@lo:400:kworker.0 Request processed in 48us (5690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.692837:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787367535.692856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446686976 00000100:00100000:0.0:1787367535.692860:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446686976 00000100:00100000:0.0:1787367535.692889:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787367535.692896:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446686976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.692926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874190446686976:12345-0@lo:400:kworker.0 Request processed in 31us (5738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.692931:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787367535.693083:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367535.693087:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367535.693090:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367535.693120:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874190446686976:0@lo:400:kworker.0 00000100:00100000:0.0:1787367535.693133:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446687104:0@lo:400:kworker.0 00000100:00100000:2.0:1787367535.693146:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446687488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367535.693185:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367535.694919:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446687488 00000100:00100000:0.0:1787367535.694943:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446687488 00000100:00100000:0.0:1787367535.695012:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787367535.695021:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446687488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367535.695058:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367535.695133:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446687488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367535.695140:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787367535.696443:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fb3bcf100 x1874190446687488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367535.696475:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446687488:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787367535.697189:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8f908c4700 x1874190446687360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787367551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367535.697213:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446687360:0@lo:400:kworker.0 00010000:00010000:3.0:1787367536.261061:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367536.908418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367536.908454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367536.908482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367536.908521:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679744 00000100:00100000:2.0:1787367536.908530:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679744 00000100:00100000:2.0:1787367536.908586:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679616 00000100:00100000:2.0:1787367536.908590:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679616 00000100:00100000:2.0:1787367536.908610:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:2.0:1787367536.908620:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425679744:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367536.908696:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2357:x1874190425679744:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367536.908703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:2.0:1787367536.908721:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00100000:2.0:1787367536.908728:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2357:x1874190425679616:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367536.908756:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2357:x1874190425679616:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367536.908772:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00080000:0.0:1787367536.909006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367536.909088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679488 00000100:00100000:1.0:1787367536.909092:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679488 00000100:00100000:1.0:1787367536.909130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 284 00000100:00100000:1.0:1787367536.909137:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425679488:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367536.909181:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425679488:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 44us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367536.909188:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 284 00010000:00010000:3.0:1787367537.284238:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367537.731520:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367537.731545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446687616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367537.731620:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367537.734986:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446687616 00000100:00100000:0.0:1787367537.735005:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446687616 00000100:00100000:0.0:1787367537.735095:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787367537.735107:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446687616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367537.735149:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367537.735276:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446687616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367537.735284:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787367537.735308:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367537.735360:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446687616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367537.749465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367537.749729:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425679872 00000100:00100000:1.0:1787367537.749740:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425679872 00000100:00100000:1.0:1787367537.749800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1787367537.749811:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10289:x1874190425679872:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367537.749830:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367537.749853:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f39a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a0e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749924:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749939:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749962:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749977:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749984:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.749990:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750269:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750277:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750283:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750289:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367537.750292:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750299:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750310:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367537.750313:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367537.750318:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750331:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f39ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750342:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750348:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750354:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750358:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367537.750361:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750367:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e8f86d97800) 00010000:00010000:1.0:1787367537.750377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367537.750380:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750386:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750418:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f39a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a0e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750440:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367537.750442:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367537.750445:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f39a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a0e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.750454:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f800, rc 0) 00000100:00100000:1.0:1787367537.750525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10289:x1874190425679872:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 715us (1072us total) trans 0 rc 301/301 00000100:00100000:1.0:1787367537.750534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00080000:2.0:1787367537.751922:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367537.770824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367537.771839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680128 00000100:00100000:3.0:1787367537.771851:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680128 00000100:00100000:3.0:1787367537.771961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1787367537.771972:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10289:x1874190425680128:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1787367537.772038:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367537.772064:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f395f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f9 expref: 9 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772081:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:3.0:1787367537.772091:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367537.772828:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772856:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772867:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367537.772879:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367537.775074:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787367537.775093:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775104:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775112:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775118:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367537.775122:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775130:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775148:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:2.0:1787367537.775151:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367537.775156:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.775163:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f39ba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367537.775231:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fc799be reply state 00000000ecf0f8e0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367537.775241:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367537.775703:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:10289:x1874190425680128:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 3663us (4819us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787367537.775713:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00010000:00010000:0.0:1787367537.779532:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779548:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779555:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779561:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367537.779565:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779584:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779600:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e8f91b61b00) 00010000:00010000:0.0:1787367537.779603:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367537.779607:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367537.779614:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f39c1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367537.926605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367537.927076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680256 00000100:00100000:1.0:1787367537.927086:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680256 00000100:00100000:1.0:1787367537.927164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:1.0:1787367537.927177:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:10297:x1874190425680256:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:1.0:1787367537.927255:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367537.927288:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f39c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a15 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927393:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927420:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367537.927496:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787367537.927512:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367537.927563:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927591:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f39c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a15 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927611:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a15 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367537.927621:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:1.0:1787367537.927624:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367537.927805:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f200, rc 0) 00000100:00100000:2.0:1787367537.927968:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:10297:x1874190425680256:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 791us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367537.927978:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1787367537.990457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367537.990927:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680384 00000100:00100000:2.0:1787367537.990938:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680384 00000100:00100000:2.0:1787367537.991002:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:2.0:1787367537.991011:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:10303:x1874190425680384:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367537.991142:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367537.991164:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f39d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a1c expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991267:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991282:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991292:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991321:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991328:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991335:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991451:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991458:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991464:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367537.991502:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787367537.991505:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367537.991547:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991559:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991565:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991572:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991586:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367537.991590:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991598:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991609:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:2.0:1787367537.991612:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367537.991616:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991622:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f39dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991780:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991786:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991793:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991798:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367537.991801:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991807:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991824:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367537.991826:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367537.991829:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991835:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f39e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991867:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f39d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a1c expref: 12 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991878:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a1c expref: 11 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.991885:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367537.991887:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787367537.991889:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75800, rc 0) 00000100:00100000:2.0:1787367537.992001:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:10303:x1874190425680384:12345-192.168.204.23@tcp:101:bash.0 Request processed in 990us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367537.992009:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:3.0:1787367537.997109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367537.997263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680640 00000100:00100000:2.0:1787367537.997274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680640 00000100:00100000:2.0:1787367537.997330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:2.0:1787367537.997340:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:10303:x1874190425680640:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367537.997373:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367537.997397:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f39f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997595:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997607:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997654:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997663:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.997670:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367537.998352:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787367537.998561:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998573:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998581:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998615:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998634:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998648:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367537.998653:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998661:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998674:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367537.998677:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367537.998681:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998688:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f39f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367537.998702:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c648c422 reply state 00000000804bd6b9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367537.998711:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787367537.998743:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f39f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998756:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367537.998775:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367537.998777:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367537.998780:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367537.998868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10303:x1874190425680640:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1529us (1770us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787367537.998877:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1787367538.003398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1787367538.003544:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003557:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003568:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003573:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367538.003578:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003586:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003603:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f890a8b00) 00010000:00010000:1.0:1787367538.003606:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367538.003626:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.003645:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3a00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367538.003830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680768 00000100:00100000:0.0:1787367538.003841:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680768 00000100:00100000:0.0:1787367538.003889:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:0.0:1787367538.003896:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874190425680768:12345-192.168.204.23@tcp:8:bash.0 00010000:00080000:0.0:1787367538.003930:0:6695:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1787367538.003961:0:6695:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f3a15 00002000:00100000:0.0:1787367538.003974:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3/ffff9e8fb3440800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367538.003999:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367538.004268:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787367538.004299:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3446000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367538.004382:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425680768:12345-192.168.204.23@tcp:8:bash.0 Request processed in 485us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367538.004389:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1787367538.007459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.007573:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425680896 00000100:00100000:0.0:1787367538.007599:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425680896 00000100:00100000:0.0:1787367538.007679:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1787367538.007689:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:0:x1874190425680896:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367538.007710:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367538.007736:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a2a expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367538.007766:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787367538.007787:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1787367538.007792:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367538.007803:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.007824:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.007838:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367538.007899:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:0:x1874190425680896:12345-192.168.204.23@tcp:101:bash.0 Request processed in 212us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367538.007907:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00080000:2.0:1787367538.008127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367538.011669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.011825:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425681024 00000100:00100000:0.0:1787367538.011836:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425681024 00000100:00100000:0.0:1787367538.011903:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1787367538.011915:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10303:x1874190425681024:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367538.011934:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367538.011954:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a31 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.012000:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.012010:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367538.012015:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367538.012021:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.012063:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.012077:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367538.012092:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874190446687744:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367538.012248:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367538.016155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.016313:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1874190446687744:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367538.016364:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.016387:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598800, rc 0) 00000100:00100000:0.0:1787367538.016452:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:10303:x1874190425681024:12345-192.168.204.23@tcp:101:bash.0 Request processed in 4539us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367538.016462:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:1.0:1787367538.016928:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425681152 00000100:00100000:1.0:1787367538.016936:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425681152 00010000:00010000:1.0:1787367538.016972:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367538.017006:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:1.0:1787367538.017015:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425681152:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367538.017028:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367538.017054:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.017067:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.017092:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3a1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a2a expref: 8 pid: 8211 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.017106:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367538.017109:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367538.017118:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.017140:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.017175:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367538.017236:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874190446687872:192.168.204.23@tcp:105: 00000100:00100000:1.0:1787367538.017405:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fb3bb50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367538.021478:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874190446687872:192.168.204.23@tcp:105: 00010000:00010000:1.0:1787367538.021520:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367538.021589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425681152:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4574us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367538.021600:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:3.0:1787367538.025179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.025506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425681408 00000100:00100000:0.0:1787367538.025518:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425681408 00000100:00100000:0.0:1787367538.025592:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:0.0:1787367538.025604:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10303:x1874190425681408:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:0.0:1787367538.025993:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10303:x1874190425681408:12345-192.168.204.23@tcp:35:bash.0 Request processed in 391us (824us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787367538.026002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1787367538.146292:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.146402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425681664 00000100:00100000:0.0:1787367538.146413:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425681664 00000100:00100000:0.0:1787367538.146479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1787367538.146502:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10313:x1874190425681664:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367538.146611:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367538.146702:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a38 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367538.146919:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787367538.147177:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3a2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a38 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.147968:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:0.0:1787367538.147974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367538.147982:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a38 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.148000:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598600, rc 0) 00000100:00100000:0.0:1787367538.148184:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10313:x1874190425681664:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1683us (1901us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787367538.148251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1787367538.153350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.154013:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425681920 00000100:00100000:2.0:1787367538.154026:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425681920 00000100:00100000:2.0:1787367538.154132:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1787367538.154144:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10313:x1874190425681920:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367538.154451:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:10313:x1874190425681920:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 308us (1111us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787367538.154459:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367538.242098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.242259:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682048 00000100:00100000:2.0:1787367538.242268:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682048 00000100:00100000:2.0:1787367538.242363:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:2.0:1787367538.242374:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:10319:x1874190425682048:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367538.242406:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367538.242433:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242552:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242565:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367538.242640:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787367538.242644:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367538.242668:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242697:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a3f expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242719:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a3f expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.242728:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367538.242731:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367538.242735:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75200, rc 0) 00000100:00100000:2.0:1787367538.242807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10319:x1874190425682048:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 435us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367538.242815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1787367538.249687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.249778:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682304 00000100:00100000:2.0:1787367538.249790:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682304 00000100:00100000:2.0:1787367538.249863:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:2.0:1787367538.249874:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10319:x1874190425682304:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367538.249904:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367538.249947:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a46 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.250066:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3a4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.250081:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.250094:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367538.250104:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367538.250259:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a46 expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.250277:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a46 expref: 19 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.250286:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367538.250290:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367538.250294:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74a00, rc 0) 00000100:00100000:2.0:1787367538.250356:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10319:x1874190425682304:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 484us (681us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787367538.250364:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:3.0:1787367538.257498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367538.258057:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682432 00000100:00100000:1.0:1787367538.258068:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682432 00000100:00100000:1.0:1787367538.258147:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1787367538.258158:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:2358:x1874190425682432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367538.258177:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367538.258231:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3a4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a46 expref: 19 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.258252:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:1.0:1787367538.258258:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367538.258331:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2358:x1874190425682432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 175us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367538.258354:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1787367538.259855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.261110:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682688 00000100:00100000:2.0:1787367538.261122:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682688 00000100:00100000:2.0:1787367538.261256:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:2.0:1787367538.261268:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10319:x1874190425682688:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367538.261310:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367538.261333:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a4d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.261450:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.261465:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.261476:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367538.261498:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367538.261631:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a4d expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.261652:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a4d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.261660:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367538.261663:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787367538.261666:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367538.261739:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10319:x1874190425682688:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 473us (1893us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787367538.261746:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:3.0:1787367538.274698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.274881:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682816 00000100:00100000:0.0:1787367538.274892:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682816 00000100:00100000:0.0:1787367538.274951:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1787367538.274962:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425682816:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1787367538.275012:0:8211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.275035:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.275044:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367538.275048:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367538.275053:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.275091:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.275104:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367538.275120:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446688000:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367538.275273:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367538.278658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367538.278825:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425682944 00000100:00100000:1.0:1787367538.278834:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425682944 00002000:00100000:1.0:1787367538.278884:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e8f908f4380 x1874190425682944/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:179/0 lens 504/0 e 0 to 0 dl 1787367549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367538.278895:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908f4380 with x1874190425682944 ext(0->12) 00010000:00010000:1.0:1787367538.278903:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 8 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.278920:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 8 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367538.278928:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f908f4380 00000100:00100000:1.0:1787367538.278965:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367538.278976:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425682944:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:0.0:1787367538.280269:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446688000:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367538.280305:0:8211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.307503:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787367538.313925:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000001:00080000:3.0:1787367538.346144:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787367538.346504:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425682944:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 67523us (67850us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787367538.346517:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00002000:00100000:1.0:1787367538.346531:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9e8f908f4380 x1874190425682944/t4294967299(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:179/0 lens 504/448 e 0 to 0 dl 1787367549 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367538.346543:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908f4380 with x1874190425682944 ext(0->12) 00010000:00010000:1.0:1787367538.346554:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.346584:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367538.346593:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f908f4380 00000100:00100000:3.0:1787367538.350597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.350674:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425683072 00000100:00100000:2.0:1787367538.350686:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425683072 00010000:00010000:2.0:1787367538.350758:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367538.350805:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1787367538.350814:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425683072:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367538.350830:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787367538.350861:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787367538.350864:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787367538 00002000:00010000:2.0:1787367538.350867:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787367538 00002000:00010000:2.0:1787367538.350869:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787367538 00002000:00010000:2.0:1787367538.350871:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787367538.350878:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.350893:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.350920:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a31 expref: 7 pid: 6695 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.350940:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367538.350945:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367538.350951:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.350961:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.350996:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367538.351158:0:8211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351169:0:8211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351213:0:8211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351221:0:8211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351229:0:8211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351236:0:8211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367538.351241:0:8211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351248:0:8211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351260:0:8211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.351275:0:8211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009162f4fc/0xcbf1f1bac53f3a70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367538.352444:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425683072:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1621us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367538.352457:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1787367538.352548:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425682816:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 77587us (77860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367538.352559:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:3.0:1787367538.355532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.355972:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425683328 00000100:00100000:0.0:1787367538.355985:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425683328 00000100:00100000:0.0:1787367538.356149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1787367538.356161:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10319:x1874190425683328:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:0.0:1787367538.356282:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a4d expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367538.356590:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787367538.356664:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787367538.357585:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787367538.357648:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.357666:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.357676:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.357715:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.357742:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 24 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367538.357756:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874190446688128:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367538.358587:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367538.363056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.363165:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874190446688128:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367538.363226:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367538.363337:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425683456 00000100:00100000:2.0:1787367538.363355:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425683456 00010000:00010000:2.0:1787367538.363397:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 25 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367538.363439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:2.0:1787367538.363449:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:2356:x1874190425683456:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367538.363465:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367538.363473:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 25 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363497:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 25 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363533:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a23 expref: 25 pid: 5841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363548:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367538.363553:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363562:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363583:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.363615:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367538.363699:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.363707:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367538.363840:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787367538.364064:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787367538.364182:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446688256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787367538.364290:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367538.364317:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f901766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367538.364600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446688256 00000100:00100000:1.0:1787367538.364607:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446688256 00000100:00100000:1.0:1787367538.364673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367538.364681:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446688256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367538.364762:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446688256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367538.364769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787367538.364889:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367538.364923:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446688256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787367538.365701:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787367538.365788:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0024380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446688384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787367538.365861:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367538.365905:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367538.366090:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:2356:x1874190425683456:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2638us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367538.366101:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367538.366294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446688384 00000100:00100000:1.0:1787367538.366301:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446688384 00000100:00100000:1.0:1787367538.366340:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367538.366349:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446688384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367538.366615:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874190446688384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 267us (753us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787367538.366634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367538.367358:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0024380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446688384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787367538.367441:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787367538.367504:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367515:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367523:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367529:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367538.367534:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367542:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367559:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367538.367562:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787367538.367567:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.367574:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3a77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787367538.367796:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787367538.368082:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787367538.368097:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343643903714ns, next at 344643900915ns, rc = 0 00000001:00080000:0.0:1787367538.368105:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787367538.368148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367538.368164:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787367538.368172:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3a62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a4d expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367538.368310:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10319:x1874190425683328:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 12151us (12791us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787367538.368320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000020:00080000:0.0:1787367538.368324:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787367538.374578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.374698:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425683584 00000100:00100000:2.0:1787367538.374708:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425683584 00000100:00100000:2.0:1787367538.374771:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1787367538.374780:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10319:x1874190425683584:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367538.374803:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367538.374828:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a54 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.374901:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a54 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.374916:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a54 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.374937:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367538.374941:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367538.374945:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367538.375011:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:10319:x1874190425683584:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 232us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367538.375019:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:1.0:1787367538.379887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.380032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425683840 00000100:00100000:2.0:1787367538.380043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425683840 00000100:00100000:2.0:1787367538.380103:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1787367538.380113:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:10319:x1874190425683840:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367538.380383:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10319:x1874190425683840:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 270us (505us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787367538.380390:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367538.527737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367538.532347:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425684096 00000100:00100000:1.0:1787367538.532364:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425684096 00000100:00100000:1.0:1787367538.532441:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:1.0:1787367538.532451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10329:x1874190425684096:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367538.532501:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367538.532785:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a5b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367538.532941:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787367538.533358:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3a85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a5b expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.533374:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:1.0:1787367538.533377:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367538.533382:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a5b expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.533398:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00100000:1.0:1787367538.533471:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10329:x1874190425684096:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1021us (5745us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787367538.533490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1787367538.543273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.543640:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425684224 00000100:00100000:2.0:1787367538.543657:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425684224 00000100:00100000:2.0:1787367538.543745:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:2.0:1787367538.543758:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10329:x1874190425684224:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1787367538.543877:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.543900:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.543914:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.543932:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.543939:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.543946:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544094:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544113:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544120:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367538.544175:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544223:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544232:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544239:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544247:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367538.544252:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544261:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544275:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367538.544279:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367538.544284:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544292:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3a93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544316:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544325:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.544331:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545488:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367538.545495:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545507:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545521:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367538.545524:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367538.545528:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545536:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3a9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545562:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545569:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545575:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545596:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367538.545600:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545606:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545800:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367538.545804:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367538.545809:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.545816:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367538.545947:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10329:x1874190425684224:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 2185us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367538.545959:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:1.0:1787367538.555109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.555300:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425684480 00000100:00100000:2.0:1787367538.555318:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425684480 00000100:00100000:2.0:1787367538.555399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367538.555412:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10329:x1874190425684480:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367538.555788:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10329:x1874190425684480:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 377us (689us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787367538.555797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1787367538.587046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.587545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425684736 00000100:00100000:2.0:1787367538.587561:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425684736 00000100:00100000:2.0:1787367538.587712:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:2.0:1787367538.587746:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10332:x1874190425684736:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367538.587786:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367538.587813:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587918:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587940:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587956:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587974:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587981:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.587987:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588519:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588538:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367538.588562:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367538.588773:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588783:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588791:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588797:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367538.588802:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588811:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588826:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367538.588830:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367538.588835:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588842:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3aaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588860:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588867:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588885:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588890:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367538.588893:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588900:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588909:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367538.588912:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367538.588915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588978:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.588995:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367538.589003:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367538.589005:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367538.589008:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367538.589291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10332:x1874190425684736:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1545us (2276us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787367538.589311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1787367538.592818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367538.592920:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425684864 00000100:00100000:1.0:1787367538.592935:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425684864 00000100:00100000:1.0:1787367538.593058:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1787367538.593071:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10332:x1874190425684864:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:1.0:1787367538.593177:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593229:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593266:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593300:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593307:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593314:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593321:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367538.593326:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593450:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593470:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367538.593484:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367538.593491:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.593498:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3acb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367538.593597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10332:x1874190425684864:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 527us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367538.593606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1787367538.595890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.596041:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425685120 00000100:00100000:0.0:1787367538.596055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425685120 00000100:00100000:0.0:1787367538.596130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367538.596143:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10332:x1874190425685120:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367538.596517:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:10332:x1874190425685120:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 376us (640us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787367538.596527:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000001:00080000:3.0:1787367538.877442:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:3.0:1787367538.877465:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787367538.877504:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f904b1b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787367538.877510:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8f91a10c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f904b1e40 00000020:00080000:3.0:1787367538.877514:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8f91a10100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fba69a400 00000020:00080000:2.0:1787367538.877570:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787367538.877765:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787367538.878234:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446688512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787367538.878349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367538.878592:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446688512 00000100:00100000:0.0:1787367538.878604:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446688512 00000100:00100000:0.0:1787367538.878671:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367538.878683:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874190446688512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787367538.878719:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787367538.878764:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a891072, atime: 0x6a891072, ctime: 0x6a891072, blocks: 0xb 00010000:00010000:0.0:1787367538.878774:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.878797:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787367538.878821:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367538.878831:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.878852:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.878863:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.878872:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.878898:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367538.879653:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446688512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 968us (1300us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787367538.879663:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787367538.879701:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367538.879709:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.879721:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367538.879727:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.879739:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.879773:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.879781:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3ad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367538.879835:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367538.879838:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367538.879841:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787367538.879849:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fa0026680/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787367538.879868:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446688512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787367538.935552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367538.935897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425685376 00000100:00100000:1.0:1787367538.935937:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425685376 00000100:00100000:1.0:1787367538.936003:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:1.0:1787367538.936014:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:10363:x1874190425685376:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1787367538.936051:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367538.936074:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3ad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a69 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.936182:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.936219:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.936245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367538.936257:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787367538.936530:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3ad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a69 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.936547:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a69 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.936555:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367538.936558:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367538.936562:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e000, rc 0) 00000100:00100000:1.0:1787367538.937109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10363:x1874190425685376:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1095us (1569us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787367538.937119:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1787367538.944273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367538.945189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367538.945416:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425685760 00000100:00100000:2.0:1787367538.945439:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425685760 00000100:00100000:2.0:1787367538.945551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1787367538.945564:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10363:x1874190425685760:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1787367538.946030:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10363:x1874190425685760:12345-192.168.204.23@tcp:35:cat.0 Request processed in 452us (828us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787367538.946042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1787367538.948377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425685632 00000100:00100000:1.0:1787367538.948396:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425685632 00000100:00100000:1.0:1787367538.948490:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367538.948501:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92390c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:2356:x1874190425685632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367538.948530:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367538.948559:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a69 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367538.948581:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367538.948588:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367538.948653:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92390c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2356:x1874190425685632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 153us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367538.948661:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1787367539.043651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.043790:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686016 00000100:00100000:2.0:1787367539.043811:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686016 00000100:00100000:2.0:1787367539.043999:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1787367539.044024:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10369:x1874190425686016:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1787367539.044065:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367539.044069:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787367539.044107:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3a3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a3f expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044132:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367539.044140:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367539.044161:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a70 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044705:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044730:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044741:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044797:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.044817:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 14 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367539.044834:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446688640:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367539.044987:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c00c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787367539.045332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367539.050178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.050476:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446688640:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367539.050506:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367539.052952:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686144 00000100:00100000:0.0:1787367539.052975:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686144 00010000:00010000:0.0:1787367539.053032:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367539.053086:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1787367539.053099:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:2357:x1874190425686144:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367539.053117:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367539.053125:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053140:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053187:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3abd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a62 expref: 15 pid: 5841 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053720:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367539.053730:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053741:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053748:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.053782:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367539.053860:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2357:x1874190425686144:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 762us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367539.053868:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00010000:00010000:2.0:1787367539.053935:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.053945:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367539.053964:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787367539.054181:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3aee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.054250:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 14 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.054259:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367539.054262:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367539.054265:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:2.0:1787367539.054296:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10369:x1874190425686016:12345-192.168.204.23@tcp:101:dd.0 Request processed in 10287us (10657us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787367539.054303:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1787367539.064564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367539.064772:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686400 00000100:00100000:0.0:1787367539.064785:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686400 00000100:00100000:0.0:1787367539.064868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:0.0:1787367539.064881:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10369:x1874190425686400:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:0.0:1787367539.065478:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.065497:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.065509:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367539.065579:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787367539.065607:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2c81aea reply state 0000000078016c85 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367539.065617:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367539.065774:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10369:x1874190425686400:12345-192.168.204.23@tcp:36:dd.0 Request processed in 894us (1223us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787367539.065782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000020:00080000:0.0:1787367539.065786:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367539.077119:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.077138:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.077146:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.077152:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367539.077157:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.077164:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.077185:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367539.077188:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367539.080210:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.080238:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.331574:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367539.363107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367539.363448:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686528 00000100:00100000:1.0:1787367539.363474:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686528 00000100:00100000:1.0:1787367539.363555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1787367539.363568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:10383:x1874190425686528:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:1.0:1787367539.363603:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367539.363645:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363759:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363778:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363818:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363837:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.363851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.364826:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.364848:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 17 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.364857:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.364904:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 17 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.365099:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 17 pid: 6718 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367539.365120:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446688768:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367539.366828:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367539.372359:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367539.372809:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686784 00000100:00100000:0.0:1787367539.372822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686784 00000100:00100000:0.0:1787367539.372906:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1787367539.372928:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:5596:x1874190425686784:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787367539.373667:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:5596:x1874190425686784:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 746us (1321us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787367539.373677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1787367539.374524:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446688768:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367539.374565:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367539.377556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367539.377739:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425686912 00000100:00100000:1.0:1787367539.377753:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425686912 00010000:00010000:1.0:1787367539.377808:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 19 pid: 6718 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367539.377929:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1787367539.377942:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:2356:x1874190425686912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367539.377963:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367539.378975:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 19 pid: 6718 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379008:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 19 pid: 6718 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379042:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3af5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a70 expref: 19 pid: 6718 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379095:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367539.379102:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379115:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379126:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.379245:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367539.379327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2356:x1874190425686912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1385us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367539.379337:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00010000:00010000:3.0:1787367539.379426:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379434:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367539.379508:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787367539.379514:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367539.379568:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379585:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379596:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379610:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379618:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379626:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367539.379631:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379640:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379651:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367539.379654:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367539.379658:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379665:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379679:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379685:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379691:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379696:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367539.379705:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379712:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f86d97f00) 00010000:00010000:3.0:1787367539.379725:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367539.379728:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379734:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3b18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379785:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a77 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379801:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a77 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.379809:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367539.379811:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367539.379813:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fe00, rc 0) 00000100:00100000:3.0:1787367539.379848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10383:x1874190425686528:12345-192.168.204.23@tcp:101:stat.0 Request processed in 16282us (16765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367539.379856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1787367539.458809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367539.459129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425687168 00000100:00100000:1.0:1787367539.459145:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425687168 00000100:00100000:1.0:1787367539.459292:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1787367539.459305:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10389:x1874190425687168:12345-192.168.204.23@tcp:36:truncate.0 00010000:00010000:1.0:1787367539.459390:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367539.459428:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a77 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.459452:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367539.459470:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367539.459783:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.459803:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.459816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367539.459881:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787367539.459911:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8261ce6 reply state 00000000ee081fec transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367539.459923:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367539.460129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10389:x1874190425687168:12345-192.168.204.23@tcp:36:truncate.0 Request processed in 825us (1339us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787367539.460138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000020:00080000:1.0:1787367539.460145:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787367539.463478:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463499:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463509:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463517:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367539.463522:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463531:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463552:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367539.463555:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367539.463560:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.463567:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3b26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367539.669430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367539.669748:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425687296 00000100:00100000:0.0:1787367539.669761:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425687296 00000100:00100000:0.0:1787367539.670078:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:0.0:1787367539.670092:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10403:x1874190425687296:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:0.0:1787367539.670124:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367539.670152:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a7e expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670280:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670298:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670314:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670331:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670338:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.670366:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.671821:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.672682:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.672701:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367539.672766:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787367539.672771:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367539.672807:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.672822:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673097:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673106:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673114:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673121:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367539.673126:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673155:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673173:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:0.0:1787367539.673177:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367539.673183:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673190:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673241:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673248:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673254:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673259:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367539.673262:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673267:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673275:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f83c18000) 00010000:00010000:0.0:1787367539.673277:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367539.673280:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673303:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673361:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3b2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673377:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 19 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.673385:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367539.673387:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367539.673390:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598000, rc 0) 00000100:00100000:0.0:1787367539.673614:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10403:x1874190425687296:12345-192.168.204.23@tcp:101:stat.0 Request processed in 3517us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367539.673627:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:0.0:1787367539.757284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367539.757404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425687552 00000100:00100000:1.0:1787367539.757417:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425687552 00000100:00100000:1.0:1787367539.757510:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:1.0:1787367539.757533:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10413:x1874190425687552:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367539.758825:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367539.758866:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a85 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367539.759708:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787367539.760000:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a85 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.760019:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:1.0:1787367539.760023:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367539.760029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a85 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.760045:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fe00, rc 0) 00000100:00100000:1.0:1787367539.760303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10413:x1874190425687552:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2782us (3034us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787367539.760315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:1.0:1787367539.763187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.763369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425687808 00000100:00100000:2.0:1787367539.763382:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425687808 00000100:00100000:2.0:1787367539.763463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1787367539.763475:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10413:x1874190425687808:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367539.764086:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10413:x1874190425687808:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 610us (911us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787367539.764097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1787367539.856333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367539.856866:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688064 00000100:00100000:3.0:1787367539.856881:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688064 00000100:00100000:3.0:1787367539.856976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1787367539.856988:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10419:x1874190425688064:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367539.857046:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367539.857073:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.857261:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.857281:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 22 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.857298:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.857351:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 22 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.857367:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 22 pid: 6718 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367539.857385:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446688896:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367539.857533:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787367539.863089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.863336:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688192 00000100:00100000:2.0:1787367539.863349:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688192 00010000:00010000:2.0:1787367539.863411:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 23 pid: 6718 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367539.863495:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:2.0:1787367539.863508:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2356:x1874190425688192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367539.863531:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367539.863540:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 23 pid: 6718 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.863556:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 23 pid: 6718 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.863589:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367539.863595:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.863619:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.863629:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.863656:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367539.863739:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2356:x1874190425688192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 234us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367539.863748:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00010000:00010000:3.0:1787367539.864767:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a7e expref: 22 pid: 6718 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367539.864793:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446688896:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367539.864823:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.864853:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.864861:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367539.864888:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787367539.865115:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.865134:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.865144:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367539.865147:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787367539.865150:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367539.865256:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:10419:x1874190425688064:12345-192.168.204.23@tcp:101:bash.0 Request processed in 8270us (8940us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787367539.865266:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1787367539.871066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.871255:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688448 00000100:00100000:2.0:1787367539.871272:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688448 00000100:00100000:2.0:1787367539.871478:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:2.0:1787367539.871491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:10419:x1874190425688448:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:2.0:1787367539.872227:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.872252:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.872265:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367539.872482:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787367539.872511:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb7c652c reply state 00000000afe62b46 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367539.872522:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367539.872859:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:10419:x1874190425688448:12345-192.168.204.23@tcp:36:bash.0 Request processed in 1365us (1800us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787367539.872871:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000020:00080000:2.0:1787367539.872879:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367539.877480:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877504:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877512:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877519:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367539.877525:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877562:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877588:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367539.877592:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367539.877683:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.877692:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3b6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367539.884321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367539.884382:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688576 00000100:00100000:0.0:1787367539.884398:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688576 00000100:00100000:0.0:1787367539.884491:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:0.0:1787367539.884503:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10419:x1874190425688576:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367539.884550:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367539.884757:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3b73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a93 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.885143:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.885164:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.885175:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.885259:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.885396:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 25 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367539.885495:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446689024:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367539.885613:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367539.888245:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f83f5df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446689024:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367539.888289:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367539.892141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.892333:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688704 00000100:00100000:2.0:1787367539.892346:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688704 00010000:00010000:2.0:1787367539.892405:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 26 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367539.892466:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1787367539.892477:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:2356:x1874190425688704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367539.892530:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367539.892540:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 26 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892569:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 26 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892616:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3b5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5a8c expref: 26 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892638:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367539.892645:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892657:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892668:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367539.892709:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367539.892788:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:2356:x1874190425688704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 312us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367539.892796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00010000:00010000:0.0:1787367539.893472:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.893486:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367539.893553:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787367539.893558:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367539.893595:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.893643:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3b73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a93 expref: 25 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.893664:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a93 expref: 24 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367539.893673:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367539.893691:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367539.893695:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598a00, rc 0) 00000100:00100000:0.0:1787367539.893742:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10419:x1874190425688576:12345-192.168.204.23@tcp:101:bash.0 Request processed in 9241us (9437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367539.893751:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:1.0:1787367539.896505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.896622:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425688960 00000100:00100000:2.0:1787367539.896634:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425688960 00000100:00100000:2.0:1787367539.896713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1787367539.896725:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10419:x1874190425688960:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:2.0:1787367539.897095:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:10419:x1874190425688960:12345-192.168.204.23@tcp:35:bash.0 Request processed in 370us (603us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787367539.897106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1787367539.965890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367539.966395:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425689216 00000100:00100000:1.0:1787367539.966409:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425689216 00000100:00100000:1.0:1787367539.966583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1787367539.966702:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:10429:x1874190425689216:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367539.966762:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367539.966796:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5a9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367539.967726:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787367539.967970:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3b81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a9a expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.967991:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:1.0:1787367539.967995:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367539.968001:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a9a expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367539.968079:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f800, rc 0) 00000100:00100000:1.0:1787367539.968383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10429:x1874190425689216:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1614us (2436us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787367539.968394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1787367539.972520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367539.972771:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425689344 00000100:00100000:3.0:1787367539.972784:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425689344 00000100:00100000:3.0:1787367539.972869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1787367539.972882:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10429:x1874190425689344:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:3.0:1787367539.972996:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.973032:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.973068:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.973087:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.973094:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.973101:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.974944:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.974965:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.974976:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367539.975136:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975152:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975158:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975165:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975184:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367539.975189:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975285:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975301:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367539.975304:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367539.975377:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975386:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975402:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975409:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975415:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975420:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367539.975422:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975429:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975458:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f91b61900) 00010000:00010000:3.0:1787367539.975461:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367539.975464:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3b96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975488:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975495:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975501:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975507:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367539.975509:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975515:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975523:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367539.975526:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367539.975529:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367539.975535:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3b9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367539.975864:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10429:x1874190425689344:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 2977us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367539.975877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:1.0:1787367539.979166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367539.979839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425689600 00000100:00100000:2.0:1787367539.979863:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425689600 00000100:00100000:2.0:1787367539.979952:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1787367539.979964:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10429:x1874190425689600:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367539.981345:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10429:x1874190425689600:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 1369us (2187us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787367539.981359:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1787367540.016262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.016454:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425689856 00000100:00100000:2.0:1787367540.016469:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425689856 00000100:00100000:2.0:1787367540.016546:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:2.0:1787367540.016560:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10432:x1874190425689856:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367540.016600:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367540.016628:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3ba4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5aa1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016738:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016758:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016774:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016794:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016801:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.016836:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017574:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3bb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017592:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017600:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367540.017611:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787367540.017730:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017738:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017746:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017753:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367540.017758:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017768:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017783:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367540.017786:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367540.017798:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017805:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3bab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017819:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017826:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017833:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017838:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367540.017842:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017848:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.017855:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367540.020104:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367540.020122:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.020136:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3bb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.020271:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3ba4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa1 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.020316:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa1 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.020325:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367540.020328:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367540.020330:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75a00, rc 0) 00000100:00100000:2.0:1787367540.020437:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10432:x1874190425689856:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3879us (4191us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787367540.020460:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1787367540.031118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.031236:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425689984 00000100:00100000:0.0:1787367540.031250:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425689984 00000100:00100000:0.0:1787367540.031333:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1787367540.031346:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10432:x1874190425689984:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1787367540.031435:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031469:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031484:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031520:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031528:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031536:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031543:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367540.031548:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031580:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031921:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367540.031926:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367540.031932:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.031940:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367540.032045:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10432:x1874190425689984:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 700us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.032055:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:1.0:1787367540.035843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367540.038753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425690240 00000100:00100000:3.0:1787367540.038777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425690240 00000100:00100000:3.0:1787367540.039269:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1787367540.039287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10432:x1874190425690240:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367540.039728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10432:x1874190425690240:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 444us (3898us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787367540.039738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1787367540.053795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.054465:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425690368 00000100:00100000:2.0:1787367540.054482:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425690368 00000100:00100000:2.0:1787367540.054999:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1787367540.055031:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:2357:x1874190425690368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367540.055057:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367540.055873:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3bb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa1 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.055911:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367540.057126:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367540.057275:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2357:x1874190425690368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 2254us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.064287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1787367540.244262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.244856:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425690624 00000100:00100000:0.0:1787367540.244871:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425690624 00000100:00100000:0.0:1787367540.244967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:0.0:1787367540.244979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10450:x1874190425690624:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1787367540.245024:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367540.245053:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5aa8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.245228:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3bd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.245248:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.245262:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367540.245301:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787367540.245533:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3bce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa8 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.245556:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa8 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.245565:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367540.245568:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787367540.245573:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599800, rc 0) 00000100:00100000:0.0:1787367540.247984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10450:x1874190425690624:12345-192.168.204.23@tcp:101:cat.0 Request processed in 2989us (3722us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787367540.248001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:3.0:1787367540.328368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.328789:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425690752 00000100:00100000:2.0:1787367540.328803:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425690752 00000100:00100000:2.0:1787367540.328885:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1787367540.328916:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10451:x1874190425690752:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367540.328954:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367540.328981:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5aaf expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.329072:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.329089:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.329101:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367540.329412:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787367540.329418:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367540.329520:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.329557:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aaf expref: 33 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.329577:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aaf expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.331085:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367540.331090:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367540.331095:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74200, rc 0) 00000100:00100000:2.0:1787367540.331233:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10451:x1874190425690752:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2312us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.331262:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367540.340766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.340997:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691136 00000100:00100000:2.0:1787367540.341011:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691136 00000100:00100000:2.0:1787367540.341081:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1787367540.341092:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10451:x1874190425691136:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367540.341696:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10451:x1874190425691136:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 601us (943us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787367540.341707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1787367540.345558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.345945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691264 00000100:00100000:2.0:1787367540.345959:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691264 00000100:00100000:2.0:1787367540.346057:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1787367540.346071:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10451:x1874190425691264:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:2.0:1787367540.346096:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787367540.346133:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3b7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a93 expref: 33 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.346162:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3bd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aa8 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.346177:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3a7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a54 expref: 31 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.346189:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367540.346267:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367540.346346:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10451:x1874190425691264:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 278us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.346378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367540.353109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.354794:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691392 00000100:00100000:2.0:1787367540.354816:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691392 00000100:00100000:2.0:1787367540.355672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:2.0:1787367540.355691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10451:x1874190425691392:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:2.0:1787367540.355898:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.355921:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.355938:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367540.356826:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367540.357056:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787367540.357135:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787367540.357348:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10451:x1874190425691392:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 1657us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.357361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00010000:00010000:1.0:1787367540.358159:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367540.383608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367540.383822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691520 00000100:00100000:1.0:1787367540.383859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691520 00000100:00100000:1.0:1787367540.383942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:1.0:1787367540.383954:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10453:x1874190425691520:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367540.384334:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367540.384365:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ab6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384486:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384508:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384523:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384543:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384551:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384558:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.384901:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385317:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385330:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367540.385394:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787367540.385400:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367540.385423:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385436:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385454:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385462:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385470:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385477:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.385481:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385490:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367540.385507:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367540.385512:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385518:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3bff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385543:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385549:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385556:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385561:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.385563:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385569:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385575:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f86d97d00) 00010000:00010000:1.0:1787367540.385577:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367540.385580:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385585:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385627:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385642:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.385659:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367540.385662:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367540.385665:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f000, rc 0) 00000100:00100000:1.0:1787367540.386913:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10453:x1874190425691520:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2947us (3317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.386931:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000040:00080000:2.0:1787367540.612667:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367540.612684:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367540.612752:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787367540.612760:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367540.612960:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0025880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446689152:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367540.613533:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367540.619670:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0025880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446689152:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367540.623298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.623514:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691648 00000100:00100000:0.0:1787367540.623527:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691648 00000100:00100000:0.0:1787367540.623721:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1787367540.623733:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691648:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787367540.623845:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691648:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 Request processed in 114us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.623853:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1787367540.641493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.641625:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691776 00000100:00100000:2.0:1787367540.641639:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691776 00000100:00100000:2.0:1787367540.641723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1787367540.641735:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691776:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367540.641787:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367540.641973:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691776:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 239us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.641983:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:3.0:1787367540.650792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.651793:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425691904 00000100:00100000:2.0:1787367540.651810:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425691904 00000100:00100000:1.0:1787367540.652039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:1.0:1787367540.652056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691904:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787367540.652169:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652209:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652225:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652365:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652375:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652383:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652419:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652462:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652469:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367540.652524:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787367540.652530:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367540.652548:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652562:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652570:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652588:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652595:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.652600:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652607:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652621:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:1.0:1787367540.652625:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367540.652631:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652649:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652666:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652672:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652677:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652682:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.652685:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652691:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652698:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9e8f86d97d00) 00010000:00010000:1.0:1787367540.652701:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367540.652704:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652709:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3c1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652724:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652730:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652742:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652747:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.652750:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652756:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652764:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367540.652767:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367540.652770:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.652777:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367540.654554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425691904:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 2485us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.654572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1787367540.664183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.664494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425692160 00000100:00100000:2.0:1787367540.664511:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425692160 00000100:00100000:2.0:1787367540.664608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:2.0:1787367540.664621:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10464:x1874190425692160:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367540.664660:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367540.664702:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5abd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.664869:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.664898:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.664913:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367540.664930:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787367540.665090:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665118:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665126:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665133:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367540.665138:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665146:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367540.665165:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367540.665171:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665177:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665572:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c29 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5abd expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665586:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:2.0:1787367540.665589:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367540.665593:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5abd expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.665605:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75a00, rc 0) 00000100:00100000:2.0:1787367540.665707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692160:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1541us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787367540.665717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:3.0:1787367540.670268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.670608:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425692288 00000100:00100000:2.0:1787367540.670623:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425692288 00000100:00100000:2.0:1787367540.670713:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:2.0:1787367540.670726:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692288:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367540.670786:0:6718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367540.670946:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692288:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 223us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.670956:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:3.0:1787367540.685791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.686416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425692544 00000100:00100000:0.0:1787367540.686430:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425692544 00000100:00100000:0.0:1787367540.686524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:0.0:1787367540.686536:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692544:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367540.686596:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367540.686601:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787367540.686641:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aaf expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.686666:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:0.0:1787367540.686673:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367540.686692:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3c3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ac4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367540.697360:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787367540.698229:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.698255:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.698271:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.698382:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3c3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ac4 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.698408:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ac4 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.698418:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f86d97d00) 00010000:00010000:1.0:1787367540.698422:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367540.698425:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fa00, rc 0) 00000100:00100000:1.0:1787367540.698668:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10464:x1874190425692544:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 12131us (12892us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787367540.698680:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:3.0:1787367540.703906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.704229:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425692800 00000100:00100000:2.0:1787367540.704244:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425692800 00000100:00100000:2.0:1787367540.704335:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:2.0:1787367540.704348:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10464:x1874190425692800:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787367540.704429:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367540.704476:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f3c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ac4 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704504:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f86d97d00) 00010000:00010000:2.0:1787367540.704517:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367540.704553:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704583:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704599:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704652:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704661:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.704669:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706638:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706661:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706669:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706676:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367540.706681:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706690:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706711:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367540.706715:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367540.706721:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706729:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3c53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706756:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706763:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706769:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706774:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367540.706777:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706784:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706793:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x19953b06 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367540.706795:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367540.706799:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.706805:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x19953b06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367540.706962:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692800:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 2608us (3074us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787367540.706973:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1787367540.711077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.711505:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425692928 00000100:00100000:2.0:1787367540.711521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425692928 00000100:00100000:2.0:1787367540.711614:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:2.0:1787367540.711638:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10464:x1874190425692928:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367540.711674:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367540.711711:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3c61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5acb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711768:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711788:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711802:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3c61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711965:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.711975:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367540.711978:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367540.711983:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74600, rc 0) 00000100:00100000:2.0:1787367540.712726:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10464:x1874190425692928:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.712736:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:3.0:1787367540.729039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367540.729156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425693184 00000100:00100000:1.0:1787367540.729170:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425693184 00000100:00100000:1.0:1787367540.729281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:1.0:1787367540.729293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10464:x1874190425693184:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367540.729410:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.729441:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.729458:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367540.730179:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787367540.730229:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346006035229ns, next at 347006031575ns, rc = 0 00000004:00010000:1.0:1787367540.730385:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a8a934a reply state 0000000019cbe1be transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367540.730397:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367540.730777:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:10464:x1874190425693184:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1480us (1747us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787367540.730787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00010000:00010000:1.0:1787367540.732692:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732711:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732720:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732727:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367540.732733:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732743:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732766:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:1.0:1787367540.732769:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787367540.732846:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.732855:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3c6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367540.738298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367540.738717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425693312 00000100:00100000:1.0:1787367540.738743:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425693312 00000100:00100000:1.0:1787367540.738826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:1.0:1787367540.738841:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:10464:x1874190425693312:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367540.740373:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367540.740425:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ad2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.740603:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.740623:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.740647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:1.0:1787367540.740650:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787367540.740655:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e000, rc 0) 00000100:00100000:1.0:1787367540.740753:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:10464:x1874190425693312:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1915us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.740762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:3.0:1787367540.748164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.748507:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425693440 00000100:00100000:2.0:1787367540.748520:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425693440 00000100:00100000:2.0:1787367540.748588:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:2.0:1787367540.748607:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874190425693440:12345-192.168.204.23@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787367540.748649:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:2.0:1787367540.748689:0:6697:0:(genops.c:1385:class_connect()) connect: client 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3, cookie 0xcbf1f1bac53f3c7d 00002000:00100000:2.0:1787367540.748705:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3/ffff9e8fbb39f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787367540.748738:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787367540.749073:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787367540.749113:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb39e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367540.749232:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2355:x1874190425693440:12345-192.168.204.23@tcp:8:lhsmtool_posix.0 Request processed in 626us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.749243:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1787367540.752632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.752725:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425693568 00000100:00100000:0.0:1787367540.752740:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425693568 00000100:00100000:0.0:1787367540.752851:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1787367540.752864:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:0:x1874190425693568:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787367540.753623:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367540.804488:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367540.804525:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446689280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367540.805808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367540.805930:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689280 00000100:00100000:2.0:1787367540.805941:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689280 00000100:00100000:2.0:1787367540.806019:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367540.806030:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446689280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367540.806080:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367540.806140:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446689280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.806148:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787367540.806174:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367540.806250:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446689280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367540.811465:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446689664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367540.811587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367540.811827:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446689408:0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.811881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367540.811912:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367540.811920:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446689792:0@lo:400:kworker.0 00000100:00100000:2.0:1787367540.811957:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367540.811999:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689664 00000100:00100000:0.0:1787367540.812011:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689664 00000100:00100000:0.0:1787367540.812087:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787367540.812187:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446689920:0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.812247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367540.812273:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367540.812280:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446689536:0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.812306:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367540.812344:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689408 00000100:00100000:1.0:1787367540.812348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689408 00000100:00100000:1.0:1787367540.812385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787367540.812400:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446689408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367540.812553:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446689664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367540.812672:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446689664:12345-0@lo:400:kworker.0 Request processed in 574us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.812681:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787367540.812702:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689920 00000100:00100000:0.0:1787367540.812712:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689920 00000100:00100000:0.0:1787367540.812830:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689536 00000100:00100000:0.0:1787367540.812834:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689536 00000100:00100000:0.0:1787367540.812860:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787367540.812867:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446689920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.812984:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446689408:12345-0@lo:400:kworker.0 Request processed in 585us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.812991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787367540.813028:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787367540.813036:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446689536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.813068:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446689536:12345-0@lo:400:kworker.0 Request processed in 34us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.813075:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787367540.813379:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446689920:12345-0@lo:400:kworker.0 Request processed in 39us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.813388:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787367540.813413:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446689792 00000100:00100000:0.0:1787367540.813418:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446689792 00000100:00080000:2.0:1787367540.813738:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367540.813745:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367540.814213:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787367540.814228:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446689792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367540.814317:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446689792:12345-0@lo:400:kworker.0 Request processed in 95us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.814325:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367540.815023:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446689536:0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.815055:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446689408:0@lo:400:kworker.0 00000100:00100000:1.0:1787367540.815073:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446689920:0@lo:400:kworker.0 00000100:00100000:3.0:1787367540.819184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446689792:0@lo:400:kworker.0 00000100:00100000:3.0:1787367540.819250:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446689664:0@lo:400:kworker.0 00000100:00100000:2.0:1787367540.849489:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:0:x1874190425693568:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 96609us (96855us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787367540.849509:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000001:00080000:1.0:1787367540.851031:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787367540.851056:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000100:00100000:3.0:1787367540.854487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367540.854577:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425693824 00000100:00100000:1.0:1787367540.854606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425693824 00000100:00100000:1.0:1787367540.854705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1787367540.854721:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:10464:x1874190425693824:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367540.855120:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:10464:x1874190425693824:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 401us (652us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787367540.855131:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1787367540.860915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.862642:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694080 00000100:00100000:2.0:1787367540.862669:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694080 00000100:00100000:2.0:1787367540.862774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:2.0:1787367540.862787:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:10464:x1874190425694080:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367540.862958:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:10464:x1874190425694080:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 173us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.862968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1787367540.870940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367540.872272:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694208 00000100:00100000:2.0:1787367540.872291:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694208 00000100:00100000:2.0:1787367540.872396:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:2.0:1787367540.872409:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:10464:x1874190425694208:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367540.872455:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367540.872493:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3c84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ad9 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872721:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872753:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872791:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367540.872844:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367540.872869:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872903:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3c84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad9 expref: 38 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872924:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad9 expref: 37 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367540.872934:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367540.872937:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787367540.872941:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75c00, rc 0) 00000100:00100000:2.0:1787367540.873034:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10464:x1874190425694208:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 628us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.873043:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1787367540.877070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.877135:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694336 00000100:00100000:0.0:1787367540.877149:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694336 00000100:00100000:0.0:1787367540.877251:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:0.0:1787367540.877264:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425694336:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367540.877289:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367540.877317:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ae0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367540.877359:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a891074, blocks: 0x1 00010000:00010000:0.0:1787367540.877385:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1787367540.877391:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367540.877405:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.877456:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367540.877473:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367540.877554:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425694336:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 293us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367540.877563:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1787367540.880423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367540.880487:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694592 00000100:00100000:3.0:1787367540.880498:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694592 00000100:00100000:3.0:1787367540.880950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:3.0:1787367540.880964:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10464:x1874190425694592:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787367540.881122:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10464:x1874190425694592:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 161us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367540.881132:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:3.0:1787367540.900810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367540.901238:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694720 00000100:00100000:1.0:1787367540.901258:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694720 00000100:00100000:1.0:1787367540.901352:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1787367540.901387:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:10464:x1874190425694720:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367540.901415:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367540.901453:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ae7 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.901494:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.901505:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367540.901510:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367540.901516:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.901563:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.902388:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367540.902420:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8211:1874190446690048:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367540.902575:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367540.912942:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8211:1874190446690048:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367540.913164:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367540.913237:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e800, rc 0) 00000100:00100000:1.0:1787367540.913387:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10464:x1874190425694720:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 12002us (12587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367540.913398:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1787367540.927455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367540.927550:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694848 00000100:00100000:3.0:1787367540.927565:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694848 00010000:00010000:3.0:1787367540.927706:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367540.927903:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1787367540.927915:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425694848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367540.927938:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367540.928296:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367540.928347:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367540.928382:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b59f997/0xcbf1f1bac53f3c92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae0 expref: 7 pid: 6695 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367540.928404:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367540.928409:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367540.928419:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367540.928441:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367540.928493:0:7633:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367540.928512:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7633:1874190446690176:192.168.204.23@tcp:105: 00000100:00100000:3.0:1787367540.928776:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367540.945992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367540.946054:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425694976 00000100:00100000:0.0:1787367540.946067:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425694976 00002000:00100000:0.0:1787367540.946137:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e8f904a6a00 x1874190425694976/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:181/0 lens 504/0 e 0 to 0 dl 1787367551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367540.946151:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f904a6a00 with x1874190425694976 ext(0->8) 00002000:00010000:0.0:1787367540.946158:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f904a6a00 00000100:00100000:0.0:1787367540.946214:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1787367540.946227:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425694976:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787367540.947145:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425694976:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 916us (1160us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787367540.947156:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00002000:00100000:0.0:1787367540.947166:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9e8f904a6a00 x1874190425694976/t4294967302(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:181/0 lens 504/448 e 0 to 0 dl 1787367551 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787367540.947177:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f904a6a00 with x1874190425694976 ext(0->8) 00002000:00010000:0.0:1787367540.947182:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f904a6a00 00000100:00100000:3.0:1787367540.948511:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7633:1874190446690176:192.168.204.23@tcp:105: 00010000:00010000:3.0:1787367540.948554:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367540.948980:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92390050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425694848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 21061us (21544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367540.948995:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:0.0:1787367540.952764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367540.952907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425695104 00000100:00100000:3.0:1787367540.952920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425695104 00000100:00100000:3.0:1787367540.952996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:3.0:1787367540.953016:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10464:x1874190425695104:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787367541.029384:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10464:x1874190425695104:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 76354us (76618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367541.029401:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000001:00080000:3.0:1787367541.029464:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1787367541.029482:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787367541.029491:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787367541.029551:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1787367541.029870:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787367541.029885:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787367541.030750:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446690304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787367541.030840:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367541.036516:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446690304 00000100:00100000:3.0:1787367541.036537:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446690304 00000100:00100000:3.0:1787367541.036680:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367541.036692:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446690304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787367541.036953:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787367541.036957:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787367541 00002000:00010000:3.0:1787367541.036960:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787367541.036962:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787367540 -> 1787367541 00002000:00010000:3.0:1787367541.036964:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787367541.037069:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446690304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 380us (6228us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787367541.037078:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1787367541.037501:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fbb10c700/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787367541.037510:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446690304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787367541.039156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.039445:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425695232 00000100:00100000:1.0:1787367541.039456:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425695232 00000100:00100000:1.0:1787367541.039525:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:1.0:1787367541.039535:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425695232:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787367541.083940:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1787367541.083976:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787367541.084178:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425695232:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 44632us (45022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.084224:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:3.0:1787367541.086668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.087418:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425695488 00000100:00100000:2.0:1787367541.087443:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425695488 00000100:00100000:2.0:1787367541.087602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:2.0:1787367541.087616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10464:x1874190425695488:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787367541.087693:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367541.087729:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3c8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad9 expref: 13 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787367541.089668:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787367541.089811:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367541.089823:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367541.089881:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.089902:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.089917:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367541.090331:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005882fe50 reply state 000000007a56517a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.090343:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367541.090531:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10464:x1874190425695488:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 2913us (3870us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787367541.090541:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00010000:00010000:0.0:1787367541.092249:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092271:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092281:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092301:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367541.092307:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092317:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092339:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367541.092342:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367541.092348:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.092356:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3ca0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.093459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.093916:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425695616 00000100:00100000:2.0:1787367541.093931:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425695616 00000100:00100000:2.0:1787367541.093998:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1787367541.094011:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425695616:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787367541.094915:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787367541.094922:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787367541 -> 1787367540 00002000:00010000:3.0:1787367541.094946:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787367538 00002000:00010000:3.0:1787367541.094948:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787367541 -> 1787367540 00002000:00010000:3.0:1787367541.094950:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787367541.095092:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425695616:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 1081us (1642us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787367541.095103:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:3.0:1787367541.112240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.113454:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425695872 00000100:00100000:0.0:1787367541.113472:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425695872 00000100:00100000:0.0:1787367541.113577:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:0.0:1787367541.113588:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10464:x1874190425695872:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787367541.113688:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.113727:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.113739:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.113782:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.113799:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 13 pid: 5841 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.113816:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446690432:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367541.113949:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367541.128891:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.128956:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696000 00000100:00100000:2.0:1787367541.128968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696000 00010000:00010000:2.0:1787367541.129028:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 14 pid: 5841 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.129088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:2.0:1787367541.129101:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2356:x1874190425696000:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367541.129122:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367541.129130:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 14 pid: 5841 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.129145:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 14 pid: 5841 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.129177:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367541.129184:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.129229:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.129240:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.129268:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367541.129348:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2356:x1874190425696000:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 249us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367541.129357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00010000:00010000:0.0:1787367541.129543:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3c68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5acb expref: 13 pid: 5841 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.129562:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446690432:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367541.129602:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129613:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129619:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129663:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129684:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129691:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129699:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367541.129704:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129712:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129723:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367541.129726:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787367541.129731:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.129737:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f3ca7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.129790:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:10464:x1874190425695872:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 16204us (17613us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787367541.129799:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:3.0:1787367541.134739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.134995:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696128 00000100:00100000:0.0:1787367541.135009:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696128 00000100:00100000:0.0:1787367541.135091:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1787367541.135115:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425696128:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787367541.135179:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.135260:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.135273:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367541.135279:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367541.135285:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.135338:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.135357:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 7 pid: 8211 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.135375:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446690560:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367541.135512:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367541.141413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.141559:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446690560:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367541.141595:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.141738:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696256 00000100:00100000:1.0:1787367541.141747:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696256 00010000:00010000:1.0:1787367541.141794:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 8 pid: 8211 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.141856:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:1.0:1787367541.141868:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425696256:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367541.141909:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367541.141939:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 8 pid: 8211 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.141957:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 8 pid: 8211 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.141994:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f3c99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ae7 expref: 8 pid: 8211 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.142016:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367541.142022:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367541.142028:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.142040:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.142081:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367541.142364:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425696256:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 495us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.142373:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00010000:00010000:3.0:1787367541.142820:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.142832:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.142952:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.142963:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.142971:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.142978:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367541.142983:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.143013:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.143029:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.143038:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3cae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.146522:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425696128:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 11391us (11778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367541.146544:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1787367541.160696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.165384:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696512 00000100:00100000:3.0:1787367541.165405:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696512 00000100:00100000:3.0:1787367541.165521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:3.0:1787367541.165535:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:10464:x1874190425696512:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787367541.165653:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.165679:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.165694:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.173440:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.173479:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.173497:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.173555:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.173579:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 13 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.173601:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446690688:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367541.173739:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367541.183124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.183461:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446690688:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367541.183499:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.184229:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696640 00000100:00100000:3.0:1787367541.184241:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696640 00010000:00010000:3.0:1787367541.184299:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.184353:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1787367541.184365:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2356:x1874190425696640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367541.184384:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367541.184392:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184405:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184444:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3c76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ad2 expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184460:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:3.0:1787367541.184466:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184477:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184486:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.184518:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367541.184591:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2356:x1874190425696640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 227us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367541.184609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00010000:00010000:0.0:1787367541.185007:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.185017:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367541.185312:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787367541.185507:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787367541.185555:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787367541.185674:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874190446690816:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787367541.185760:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367541.185810:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787367541.186600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446690816 00000100:00100000:2.0:1787367541.186616:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446690816 00000100:00100000:2.0:1787367541.186675:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367541.186684:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874190446690816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787367541.186803:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874190446690816:12345-0@lo:1000:mdt00_000.0 Request processed in 120us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367541.186810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367541.187055:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787367541.187063:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fbb10c700, transno 4294967303 00000100:00100000:0.0:1787367541.187087:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874190446690816:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787367541.188541:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787367541.188722:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874190446690944:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787367541.188801:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367541.189011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446690944 00000100:00100000:1.0:1787367541.189020:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446690944 00000100:00100000:1.0:1787367541.189083:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367541.189093:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874190446690944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787367541.189096:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367541.189520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874190446690944:12345-0@lo:1000:mdt00_000.0 Request processed in 427us (717us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787367541.189536:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367541.189614:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1874190446690944:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787367541.189664:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189676:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189684:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189691:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.189696:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189705:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189727:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367541.189731:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367541.189738:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189745:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3cbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189806:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189814:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189819:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189824:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.189827:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189833:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189841:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367541.189844:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367541.189847:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f3bf1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189977:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.189996:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.190006:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.190049:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.190067:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 16 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.190082:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446691072:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367541.190304:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fc2156900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367541.196019:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446691072:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367541.196063:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.198610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.199141:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425696768 00000100:00100000:1.0:1787367541.199154:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425696768 00010000:00010000:1.0:1787367541.199238:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 17 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.199359:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1787367541.199375:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:2356:x1874190425696768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367541.199398:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367541.199407:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 17 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199435:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 17 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199465:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3c0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ab6 expref: 17 pid: 5842 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199484:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367541.199490:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199513:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199522:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.199561:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367541.199645:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:2356:x1874190425696768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 274us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367541.199655:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00010000:00010000:1.0:1787367541.200759:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200777:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200792:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200799:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200807:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200813:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.200818:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200827:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200855:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367541.200859:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.200865:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200872:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f3cc3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200885:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200892:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200898:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200903:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.200906:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200913:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200922:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367541.200924:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367541.200927:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.200932:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3cb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367541.202153:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367541.202163:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787367541.202223:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10464:x1874190425696512:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 36661us (41522us total) trans 4294967360 rc 0/0 00000040:00080000:0.0:1787367541.202242:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787367541.202255:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367541.202379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000020:00080000:1.0:1787367541.202387:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787367541.216265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.217040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425697024 00000100:00100000:1.0:1787367541.217055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425697024 00000100:00100000:1.0:1787367541.217148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1787367541.217159:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10464:x1874190425697024:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787367541.219186:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787367541.219411:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787367541.219516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219538:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219552:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219940:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219951:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219958:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.219988:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367541.220795:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367541.220808:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.220819:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367541.220824:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.220835:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.220860:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9e8f86d97e00) 00010000:00010000:0.0:1787367541.220864:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787367541.220870:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.220898:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.220927:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367541.220930:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367541.220932:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367541.222242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10464:x1874190425697024:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 5064us (5971us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787367541.222264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000020:00080000:1.0:1787367541.222276:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787367541.331009:0:11997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367541.331024:0:11997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367541.331077:0:11997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787367541.331084:0:11997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787367541.381774:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367541.470018:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.470139:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425697280 00000100:00100000:1.0:1787367541.470154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425697280 00000100:00100000:1.0:1787367541.470255:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:1.0:1787367541.470268:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:10474:x1874190425697280:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367541.470364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367541.470400:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5aee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.471010:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.471119:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.471135:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367541.471152:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787367541.471451:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aee expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.471473:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aee expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.471483:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367541.471494:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367541.471499:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e800, rc 0) 00000100:00100000:1.0:1787367541.471601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10474:x1874190425697280:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1335us (1604us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787367541.471614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:3.0:1787367541.478415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.478553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425697408 00000100:00100000:1.0:1787367541.478576:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425697408 00000100:00100000:1.0:1787367541.478659:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:1.0:1787367541.478671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10474:x1874190425697408:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:1.0:1787367541.478785:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.478808:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.478824:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.478844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.478852:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.478859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479302:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479313:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479331:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367541.479384:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479399:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479406:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479415:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479459:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.479465:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479475:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479492:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367541.479496:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.479502:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479509:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f3ce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479524:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479541:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479548:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479553:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.479557:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479564:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479573:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f86d97a00) 00010000:00010000:1.0:1787367541.479576:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.479579:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479586:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3ced lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479603:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479609:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479616:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479622:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.479633:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479640:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479648:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f86d97100) 00010000:00010000:1.0:1787367541.479651:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.479654:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.479660:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3cf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.479768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10474:x1874190425697408:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1094us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.479778:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:3.0:1787367541.533733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.533904:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425697664 00000100:00100000:0.0:1787367541.533915:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425697664 00000100:00100000:0.0:1787367541.533978:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:0.0:1787367541.533989:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10477:x1874190425697664:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367541.534008:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367541.534030:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3cfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5af5 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534110:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534125:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534136:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534151:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534165:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534172:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534713:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534724:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534733:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367541.534743:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787367541.534852:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534859:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534866:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534873:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367541.534877:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534885:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534908:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:0.0:1787367541.534911:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367541.534916:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534923:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534936:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534941:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534946:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534951:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367541.534954:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534960:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534967:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f83c18800) 00010000:00010000:0.0:1787367541.534969:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367541.534972:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.534977:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.535032:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3cfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 22 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.535047:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 21 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.535054:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367541.535056:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367541.535059:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598000, rc 0) 00000100:00100000:0.0:1787367541.535215:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10477:x1874190425697664:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1227us (1491us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787367541.535224:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:2.0:1787367541.538412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.538621:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425697792 00000100:00100000:0.0:1787367541.538631:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425697792 00000100:00100000:0.0:1787367541.538688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:0.0:1787367541.538699:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10477:x1874190425697792:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1787367541.538772:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538789:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538801:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538826:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538850:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538857:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538863:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367541.538867:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538875:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538887:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367541.538890:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367541.538894:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.538901:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.538968:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10477:x1874190425697792:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 270us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367541.538975:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:2.0:1787367541.541098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.541168:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698048 00000100:00100000:0.0:1787367541.541177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698048 00000100:00100000:0.0:1787367541.541246:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1787367541.541255:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10477:x1874190425698048:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367541.542006:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:10477:x1874190425698048:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 747us (916us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787367541.542032:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1787367541.570723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.570831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698304 00000100:00100000:3.0:1787367541.570849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698304 00000100:00100000:3.0:1787367541.570946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:3.0:1787367541.570957:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:10006:x1874190425698304:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367541.570996:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367541.571027:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3d25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5afc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.571167:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.571185:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 23 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.571230:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.571289:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 23 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.571310:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 23 pid: 6718 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.571329:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446691200:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367541.571957:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f88f10900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367541.581084:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446691200:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367541.581128:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.587343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.587392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698432 00000100:00100000:1.0:1787367541.587402:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698432 00010000:00010000:1.0:1787367541.587458:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 24 pid: 6718 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.587501:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:1.0:1787367541.587514:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:2357:x1874190425698432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367541.587533:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367541.587551:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 24 pid: 6718 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587566:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 24 pid: 6718 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f3d10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5af5 expref: 24 pid: 6718 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587609:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367541.587615:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587624:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587632:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587665:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367541.587723:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2357:x1874190425698432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 212us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.587731:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00010000:00010000:1.0:1787367541.587843:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.587851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367541.587871:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787367541.588057:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3d25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.588083:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.588092:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367541.588095:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367541.588113:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f800, rc 0) 00000100:00100000:1.0:1787367541.588156:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:10006:x1874190425698304:12345-192.168.204.23@tcp:101:bash.0 Request processed in 17200us (17446us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787367541.588164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:1.0:1787367541.593995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.594064:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698688 00000100:00100000:2.0:1787367541.594074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698688 00000100:00100000:2.0:1787367541.594168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:2.0:1787367541.594182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:10006:x1874190425698688:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:2.0:1787367541.594743:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.594771:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.594785:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367541.594850:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787367541.594882:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064da25b3 reply state 00000000a6d9f60c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.594903:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787367541.594958:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787367541.595088:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10006:x1874190425698688:12345-192.168.204.23@tcp:36:bash.0 Request processed in 907us (1103us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787367541.595099:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000020:00080000:2.0:1787367541.595105:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787367541.600872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.600926:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698816 00000100:00100000:2.0:1787367541.600937:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698816 00000100:00100000:2.0:1787367541.601014:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:2.0:1787367541.601026:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10006:x1874190425698816:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367541.601055:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367541.601079:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3d41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b03 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.601159:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3d41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b03 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.601178:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3d41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b03 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.601224:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:2.0:1787367541.601228:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367541.601232:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75600, rc 0) 00000100:00100000:2.0:1787367541.601295:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:10006:x1874190425698816:12345-192.168.204.23@tcp:101:bash.0 Request processed in 270us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367541.601305:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 90 00010000:00010000:1.0:1787367541.601581:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601591:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601684:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601691:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.601696:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601705:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601725:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367541.601728:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.601744:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.601751:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3d3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.605896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.607007:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425698944 00000100:00100000:1.0:1787367541.607029:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425698944 00000100:00100000:1.0:1787367541.607095:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1787367541.607105:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:10006:x1874190425698944:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1787367541.607125:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367541.607149:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b0a expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367541.607178:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a891074, atime: 0x6a891072, ctime: 0x6a891074, blocks: 0xb 00010000:00010000:1.0:1787367541.607217:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1787367541.607223:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367541.607233:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.607251:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 7 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.607266:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f000, rc 0) 00000100:00100000:0.0:1787367541.607439:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10006:x1874190425698944:12345-192.168.204.23@tcp:101:bash.0 Request processed in 325us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367541.607452:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:2.0:1787367541.628407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.629945:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699072 00000100:00100000:1.0:1787367541.629961:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699072 00002000:00010000:1.0:1787367541.630011:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787367541.630016:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908c6680 with x1874190425699072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787367541.630044:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f908c6680. 00000100:00100000:1.0:1787367541.630090:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:1.0:1787367541.630102:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425699072:12345-192.168.204.23@tcp:10:bash.0 00002000:00010000:1.0:1787367541.630487:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787367541.630491:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787367540 -> 1787367541 00002000:00010000:1.0:1787367541.630494:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787367538 -> 1787367538 00002000:00010000:1.0:1787367541.630497:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787367540 -> 1787367541 00002000:00010000:1.0:1787367541.630499:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787367541.630562:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2358:x1874190425699072:12345-192.168.204.23@tcp:10:bash.0 Request processed in 462us (2164us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787367541.630570:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00002000:00010000:1.0:1787367541.630573:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787367541.630576:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908c6680 with x1874190425699072 ext(0->18446744073709551615) 00002000:00010000:1.0:1787367541.630581:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f908c6680. 00000100:00100000:2.0:1787367541.706444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.706606:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699200 00000100:00100000:1.0:1787367541.706617:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699200 00000100:00100000:1.0:1787367541.706671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1787367541.706679:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10491:x1874190425699200:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:1.0:1787367541.706749:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.706775:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.706786:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.706824:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.706831:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.706838:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707126:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707143:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367541.707179:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707217:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707224:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707231:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707247:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.707251:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707264:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707278:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367541.707281:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.707286:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707292:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707304:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707310:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707317:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707321:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.707324:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707330:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707336:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f86d97700) 00010000:00010000:1.0:1787367541.707338:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.707340:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707355:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3d56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707368:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707373:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707379:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707384:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.707387:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707392:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707399:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367541.707401:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367541.707403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.707408:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.707497:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10491:x1874190425699200:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 816us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.707504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:2.0:1787367541.741711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.741858:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699456 00000100:00100000:0.0:1787367541.741871:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699456 00000100:00100000:0.0:1787367541.742173:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:0.0:1787367541.742186:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:10494:x1874190425699456:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367541.742263:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367541.742299:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b11 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742405:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742435:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742453:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742473:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742481:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742488:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742945:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742957:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.742965:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367541.742977:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787367541.743982:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.743998:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744007:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744117:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367541.744124:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744134:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744154:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367541.744157:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367541.744162:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744168:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744184:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744356:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744365:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744384:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367541.744388:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744395:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744404:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f83c18800) 00010000:00010000:3.0:1787367541.744406:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367541.744410:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744427:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3d72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744495:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f3d64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b11 expref: 30 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744513:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b11 expref: 29 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.744522:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:3.0:1787367541.744525:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787367541.744528:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598a00, rc 0) 00000100:00100000:3.0:1787367541.744634:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10494:x1874190425699456:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2449us (2937us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787367541.744644:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:3.0:1787367541.747826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.748037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699584 00000100:00100000:1.0:1787367541.748053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699584 00000100:00100000:1.0:1787367541.748135:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:1.0:1787367541.748148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10494:x1874190425699584:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:1.0:1787367541.748472:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.748499:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.748512:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.748568:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.748585:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 29 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.748604:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbaefed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446691328:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367541.748789:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367541.752511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.752998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699840 00000100:00100000:3.0:1787367541.753011:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699840 00000100:00100000:3.0:1787367541.753089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:3.0:1787367541.753100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:5596:x1874190425699840:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787367541.753703:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:5596:x1874190425699840:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 601us (1203us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787367541.753713:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1787367541.756022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.756187:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425699968 00000100:00100000:3.0:1787367541.756231:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425699968 00010000:00010000:3.0:1787367541.756299:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 31 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.756344:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1787367541.756355:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:2356:x1874190425699968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367541.756376:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367541.756384:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 31 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.756400:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 31 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.756441:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:3.0:1787367541.756447:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.756459:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.756484:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.756514:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367541.756604:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:2356:x1874190425699968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 250us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367541.756613:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00010000:00010000:1.0:1787367541.757767:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3d2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5afc expref: 30 pid: 5842 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.757793:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbaefed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446691328:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367541.757825:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757859:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757866:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757911:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757927:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367541.757939:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757949:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757966:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367541.757970:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367541.757975:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.757982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.758104:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10494:x1874190425699584:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 9955us (10294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.758123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:3.0:1787367541.760666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.760762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425700224 00000100:00100000:0.0:1787367541.760777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425700224 00000100:00100000:0.0:1787367541.760855:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1787367541.760867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:10494:x1874190425700224:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367541.762234:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10494:x1874190425700224:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 1359us (1573us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787367541.762248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:3.0:1787367541.852268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.852511:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425700480 00000100:00100000:2.0:1787367541.852523:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425700480 00000100:00100000:2.0:1787367541.852613:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:2.0:1787367541.852625:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:10505:x1874190425700480:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1787367541.852660:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367541.852688:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3d8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852792:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852828:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852846:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852854:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.852861:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853779:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853810:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367541.853825:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787367541.853953:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853962:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853971:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853979:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.853984:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.853993:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854009:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367541.854012:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367541.854149:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854171:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3d95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854330:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854338:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854344:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854351:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.854354:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854360:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854369:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f829e0a00) 00010000:00010000:2.0:1787367541.854372:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367541.854377:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854383:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3d9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854454:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3d8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b18 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854472:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b18 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.854488:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:2.0:1787367541.854491:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367541.854494:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75a00, rc 0) 00000100:00100000:2.0:1787367541.854608:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10505:x1874190425700480:12345-192.168.204.23@tcp:101:cat.0 Request processed in 1984us (2355us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787367541.854618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:2.0:1787367541.861895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.862120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425700736 00000100:00100000:1.0:1787367541.862135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425700736 00000100:00100000:1.0:1787367541.862234:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1787367541.862246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10505:x1874190425700736:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1787367541.862601:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10505:x1874190425700736:12345-192.168.204.23@tcp:35:cat.0 Request processed in 354us (720us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787367541.862611:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1787367541.883356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367541.883530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425700992 00000100:00100000:2.0:1787367541.883544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425700992 00000100:00100000:2.0:1787367541.883632:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:2.0:1787367541.883646:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10506:x1874190425700992:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:2.0:1787367541.883740:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787367541.883780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f3da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b18 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883804:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b11 expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3d41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b03 expref: 31 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883829:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:2.0:1787367541.883841:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367541.883869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883921:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883939:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883946:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.883952:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.885123:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.885144:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.885156:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367541.885940:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787367541.885953:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347161760087ns, next at 348161756892ns, rc = 0 00010000:00010000:2.0:1787367541.886032:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886046:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886079:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886086:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886092:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886122:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367541.886151:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886158:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886165:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886172:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.886177:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886186:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886244:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367541.886248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787367541.886260:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886268:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3dbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886292:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886299:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886305:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886311:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.886314:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886321:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886330:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367541.886333:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367541.886335:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.886342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3db1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367541.886353:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f981efd4 reply state 00000000ed524809 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367541.886371:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367541.886520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:10506:x1874190425700992:12345-192.168.204.23@tcp:36:rm.0 Request processed in 2869us (3173us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787367541.886531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00010000:00010000:1.0:1787367541.886812:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367541.886822:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.886830:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367541.886833:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.886840:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.886852:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367541.886855:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787367541.886858:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.886865:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f3dc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.886884:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367541.886894:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367541.886896:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367541.889314:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889336:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889344:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889351:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.889360:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889368:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889388:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f829e0a00) 00010000:00010000:2.0:1787367541.889433:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367541.889440:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.889449:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f3db8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.945444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.948950:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425701248 00000100:00100000:3.0:1787367541.948973:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425701248 00000100:00100000:3.0:1787367541.949095:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:3.0:1787367541.949108:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:10512:x1874190425701248:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367541.949150:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367541.949182:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3dcd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b1f expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949401:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949433:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949447:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949467:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949508:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.949515:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367541.953519:0:6718:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787367541.953814:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953843:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953861:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953918:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953927:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953935:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953943:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367541.953949:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953957:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.953996:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367541.954000:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367541.954006:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.954014:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3dd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367541.954037:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057350164 reply state 000000003e544138 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367541.954049:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787367541.954108:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3dcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 34 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.954129:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 33 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.954138:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:3.0:1787367541.954142:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367541.954144:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ea00, rc 0) 00000100:00100000:3.0:1787367541.954363:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:10512:x1874190425701248:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5256us (8934us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787367541.954376:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 96 00010000:00010000:2.0:1787367541.960614:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960665:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960674:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960679:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367541.960685:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960693:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960713:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f91b61d00) 00010000:00010000:2.0:1787367541.960717:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367541.960723:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367541.960730:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f3ddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.975185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367541.975646:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425701376 00000100:00100000:3.0:1787367541.975662:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425701376 00000100:00100000:3.0:1787367541.975844:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1787367541.975858:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425701376:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367541.975906:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367541.975939:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367541.975978:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367541.976003:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1787367541.976008:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367541.976020:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.976047:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367541.976062:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e200, rc 0) 00000100:00100000:3.0:1787367541.976150:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425701376:12345-192.168.204.23@tcp:101:bash.0 Request processed in 296us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367541.976159:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00080000:2.0:1787367541.981802:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367541.984872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367541.985941:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425701504 00000100:00100000:0.0:1787367541.985956:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425701504 00000100:00100000:0.0:1787367541.986049:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1787367541.986061:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:10512:x1874190425701504:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367541.986086:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367541.986110:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b2d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.986151:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.986183:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367541.986208:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367541.986216:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.986275:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.986292:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 7 pid: 6696 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.986309:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f908f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446691456:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367541.986435:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367541.989122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367541.989475:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425701632 00000100:00100000:1.0:1787367541.989487:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425701632 00010000:00010000:1.0:1787367541.989563:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 8 pid: 6696 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.989619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1787367541.989631:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425701632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367541.989654:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367541.989684:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 8 pid: 6696 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.989702:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 8 pid: 6696 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.989736:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367541.989741:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367541.989751:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.989765:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367541.989817:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367541.989859:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbaefca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874190446691584:192.168.204.23@tcp:105: 00000100:00100000:1.0:1787367541.989984:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787367541.991512:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4090c71/0xcbf1f1bac53f3df0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b26 expref: 8 pid: 6696 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367541.991539:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f908f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446691456:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367541.991589:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367541.991606:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367541.991695:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:10512:x1874190425701504:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5635us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367541.991728:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:1.0:1787367541.999787:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbaefca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1874190446691584:192.168.204.23@tcp:105: 00010000:00010000:1.0:1787367541.999829:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367541.999907:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425701632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 10277us (10801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367541.999920:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1787367542.008081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.008250:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425701888 00000100:00100000:0.0:1787367542.008264:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425701888 00000100:00100000:0.0:1787367542.008363:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1787367542.008377:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:10512:x1874190425701888:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:0.0:1787367542.008936:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:10512:x1874190425701888:12345-192.168.204.23@tcp:35:bash.0 Request processed in 557us (867us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787367542.008946:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:2.0:1787367542.018586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.018643:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.018683:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.018798:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702016 00000100:00100000:0.0:1787367542.018812:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702016 00000100:00100000:0.0:1787367542.018887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 286 00000100:00100000:0.0:1787367542.018900:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425702016:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367542.018999:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425702016:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367542.019008:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 286 00000100:00100000:3.0:1787367542.019968:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702144 00000100:00100000:3.0:1787367542.019978:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702144 00000100:00100000:3.0:1787367542.020051:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367542.020062:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425702144:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367542.020142:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425702144:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 82us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.020150:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00080000:0.0:1787367542.020763:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367542.028616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702272 00000100:00100000:1.0:1787367542.028637:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702272 00000100:00100000:1.0:1787367542.028756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:1.0:1787367542.028771:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425702272:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367542.028886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425702272:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 118us (10201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367542.028895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00080000:0.0:1787367542.030934:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367542.270150:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367542.270663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702400 00000100:00100000:1.0:1787367542.270684:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702400 00000100:00100000:1.0:1787367542.270948:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:1.0:1787367542.270960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:10527:x1874190425702400:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367542.270986:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367542.271008:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b34 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271077:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271106:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271118:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367542.271682:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787367542.271688:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367542.271717:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271758:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b34 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271778:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b34 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.271786:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367542.271789:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367542.271792:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00100000:1.0:1787367542.271867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:10527:x1874190425702400:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 909us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367542.271875:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:0.0:1787367542.281099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367542.281234:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702656 00000100:00100000:1.0:1787367542.281245:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702656 00000100:00100000:1.0:1787367542.281318:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:1.0:1787367542.281329:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:10527:x1874190425702656:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367542.281352:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367542.281399:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3e0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b3b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.281525:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3e13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.281552:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.281566:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3e13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367542.281579:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787367542.282109:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3e0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b3b expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.282131:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3e13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b3b expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.282141:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:1.0:1787367542.282144:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367542.282148:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fe00, rc 0) 00000100:00100000:1.0:1787367542.282256:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:10527:x1874190425702656:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 928us (1166us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787367542.282264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:2.0:1787367542.289155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.289373:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703040 00000100:00100000:3.0:1787367542.289393:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703040 00000100:00100000:3.0:1787367542.289474:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1787367542.289485:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:2357:x1874190425703040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367542.289503:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367542.289531:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3e13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b3b expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.289562:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.289568:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367542.290047:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:2357:x1874190425703040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 562us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.290055:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1787367542.302744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.307493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425702912 00000100:00100000:3.0:1787367542.307509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425702912 00000100:00100000:3.0:1787367542.307629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1787367542.307639:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:10527:x1874190425702912:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367542.307664:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367542.307697:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b42 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.307798:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.307812:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.307822:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367542.307850:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787367542.307980:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b42 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.307999:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b42 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.308007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.308010:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787367542.308014:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367542.308089:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:10527:x1874190425702912:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 450us (5354us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787367542.308097:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:2.0:1787367542.324973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.325117:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703168 00000100:00100000:0.0:1787367542.325128:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703168 00000100:00100000:0.0:1787367542.325274:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1787367542.325287:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425703168:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1787367542.325339:0:8211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.325363:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.325390:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367542.325395:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367542.325410:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.325465:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.325481:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 6 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367542.325495:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446691712:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367542.325579:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367542.330933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.331033:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703296 00000100:00100000:2.0:1787367542.331058:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703296 00002000:00100000:2.0:1787367542.331108:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e8fbaefd180 x1874190425703296/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:183/0 lens 504/0 e 0 to 0 dl 1787367553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367542.331118:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbaefd180 with x1874190425703296 ext(0->8) 00010000:00010000:2.0:1787367542.331128:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.331146:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 7 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367542.331155:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8fbaefd180 00000100:00100000:2.0:1787367542.331242:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1787367542.331253:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425703296:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:2.0:1787367542.331779:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425703296:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 525us (854us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787367542.331788:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00002000:00100000:2.0:1787367542.331796:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9e8fbaefd180 x1874190425703296/t4294967302(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:183/0 lens 504/448 e 0 to 0 dl 1787367553 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367542.331804:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbaefd180 with x1874190425703296 ext(0->8) 00010000:00010000:2.0:1787367542.331810:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.331824:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367542.331831:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8fbaefd180 00000100:00100000:0.0:1787367542.332409:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446691712:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367542.332435:0:8211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367542.340327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.340427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703424 00000100:00100000:3.0:1787367542.340437:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703424 00010000:00010000:3.0:1787367542.340484:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.340532:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:3.0:1787367542.340543:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2357:x1874190425703424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367542.340564:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787367542.340598:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787367542.340602:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787367542 00002000:00010000:3.0:1787367542.340604:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787367542 00002000:00010000:3.0:1787367542.340607:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787367542 00010000:00010000:3.0:1787367542.340613:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.340641:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.340683:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b59f997/0xcbf1f1bac53f3df7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b2d expref: 9 pid: 6697 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.340705:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367542.340709:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367542.340716:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.340726:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.340754:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367542.340827:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425703424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 285us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.340835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00010000:00010000:0.0:1787367542.341449:0:8211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341462:0:8211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341489:0:8211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341505:0:8211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341513:0:8211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341519:0:8211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367542.341524:0:8211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341534:0:8211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341547:0:8211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.341555:0:8211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfea9cba/0xcbf1f1bac53f3e36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367542.341625:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425703168:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 16341us (16666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367542.341633:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1787367542.356055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.356217:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703680 00000100:00100000:0.0:1787367542.356306:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703680 00000100:00100000:0.0:1787367542.356442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1787367542.356471:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:10527:x1874190425703680:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:0.0:1787367542.356551:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b42 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367542.356904:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787367542.356950:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787367542.357378:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787367542.357454:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.357472:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 42 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.357481:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.357516:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 42 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.357533:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 42 pid: 6718 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367542.357547:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874190446691840:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367542.357643:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367542.362582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.362828:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703808 00000100:00100000:2.0:1787367542.362838:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703808 00010000:00010000:2.0:1787367542.362882:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 43 pid: 6718 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367542.362927:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1787367542.362938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:2356:x1874190425703808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367542.362955:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367542.362962:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 43 pid: 6718 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.362976:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 43 pid: 6718 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.363002:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:2.0:1787367542.363008:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.363018:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.363026:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.363046:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367542.363107:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:2356:x1874190425703808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367542.363116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00010000:00010000:0.0:1787367542.363867:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3de2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b1f expref: 42 pid: 6718 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367542.363891:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874190446691840:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367542.363929:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.363939:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.363944:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367542.364079:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787367542.364479:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787367542.364901:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446691968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367542.364977:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367542.365096:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787367542.371568:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446691968 00000100:00100000:0.0:1787367542.371587:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446691968 00000100:00100000:0.0:1787367542.371689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367542.371702:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1874190446691968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367542.371847:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1874190446691968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (6869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367542.371855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787367542.371965:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367542.372070:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446691968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787367542.372674:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787367542.372767:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446692096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787367542.372820:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367542.372850:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f88f109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367542.373079:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446692096 00000100:00100000:0.0:1787367542.373085:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446692096 00000100:00100000:0.0:1787367542.373113:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367542.373120:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1874190446692096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787367542.373469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5845:x1874190446692096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 348us (647us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787367542.373477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367542.373932:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446692096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787367542.374002:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787367542.374043:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374053:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374061:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374066:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.374070:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374078:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.374098:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787367542.374103:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.374109:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f3e3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367542.374329:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787367542.374433:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787367542.374445:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347650251419ns, next at 348650249247ns, rc = 0 00000001:00080000:3.0:1787367542.374451:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787367542.374485:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.374488:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787367542.374502:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b42 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.374880:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:10527:x1874190425703680:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 18410us (18834us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787367542.374891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000020:00080000:3.0:1787367542.374896:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787367542.388739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.388874:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425703936 00000100:00100000:0.0:1787367542.388885:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425703936 00000100:00100000:0.0:1787367542.388961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:0.0:1787367542.388972:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:10527:x1874190425703936:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367542.389001:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367542.389029:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3e44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b49 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.389095:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3e44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b49 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.389110:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3e44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b49 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.389131:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367542.389135:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367542.389138:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599e00, rc 0) 00000100:00100000:0.0:1787367542.389679:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+46:10527:x1874190425703936:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 697us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367542.389687:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:2.0:1787367542.392428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.392724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425704192 00000100:00100000:3.0:1787367542.392735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425704192 00000100:00100000:3.0:1787367542.392796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1787367542.392806:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+46:10527:x1874190425704192:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367542.393056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:10527:x1874190425704192:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 251us (638us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787367542.393065:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00010000:00010000:0.0:1787367542.403511:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367542.516336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.516496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425704320 00000100:00100000:3.0:1787367542.516506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425704320 00000100:00100000:3.0:1787367542.516832:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:3.0:1787367542.516843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:10538:x1874190425704320:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:3.0:1787367542.516938:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.516957:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.516969:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.516982:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517010:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517130:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517140:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517147:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367542.517236:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517259:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517266:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517273:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.517277:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517284:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517304:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367542.517307:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.517312:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517319:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517334:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517340:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517345:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517350:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.517352:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517358:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.517365:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.517367:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.517370:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518352:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518421:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518428:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518435:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518441:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.518444:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518451:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518463:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.518466:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.518470:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.518477:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.518626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:10538:x1874190425704320:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1770us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.518638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:1.0:1787367542.568786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.568885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425704576 00000100:00100000:3.0:1787367542.568896:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425704576 00000100:00100000:3.0:1787367542.568954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:3.0:1787367542.568979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:10541:x1874190425704576:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367542.569005:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367542.569026:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569103:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569121:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569132:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569146:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569154:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569161:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569327:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3e75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569336:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569344:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367542.569364:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787367542.569474:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569481:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569487:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569493:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.569498:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569505:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569518:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367542.569522:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.569527:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569533:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569548:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569554:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569570:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569575:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.569578:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569584:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569592:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.569594:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.569597:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569603:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569644:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b50 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569656:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b50 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.569663:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.569665:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367542.569667:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e400, rc 0) 00000100:00100000:3.0:1787367542.569914:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+49:10541:x1874190425704576:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 936us (1136us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787367542.569931:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:1.0:1787367542.588658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.589066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425704704 00000100:00100000:3.0:1787367542.589079:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425704704 00000100:00100000:3.0:1787367542.589152:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:3.0:1787367542.589164:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+49:10541:x1874190425704704:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1787367542.589926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.589950:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.589962:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.589994:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590002:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590010:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590019:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.590024:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590033:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590048:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.590069:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367542.590075:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.590082:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.590242:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+49:10541:x1874190425704704:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 1031us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.590252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:1.0:1787367542.605509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.605842:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425704960 00000100:00100000:3.0:1787367542.605853:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425704960 00000100:00100000:3.0:1787367542.605921:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1787367542.605931:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+49:10541:x1874190425704960:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367542.606176:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:10541:x1874190425704960:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 245us (676us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787367542.606185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1787367542.733945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.734103:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425705216 00000100:00100000:2.0:1787367542.734117:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425705216 00000100:00100000:2.0:1787367542.734241:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:2.0:1787367542.734255:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:10551:x1874190425705216:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367542.734288:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367542.734292:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787367542.734328:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3e05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b34 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.734352:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367542.734358:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367542.735002:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3e8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b57 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.735122:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.735137:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.735148:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367542.735160:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787367542.735352:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3e8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b57 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.735383:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b57 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.735419:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367542.735422:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367542.735425:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74800, rc 0) 00000100:00100000:2.0:1787367542.735488:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:10551:x1874190425705216:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1237us (1557us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787367542.735497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:1.0:1787367542.743260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.743665:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425705472 00000100:00100000:3.0:1787367542.743684:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425705472 00000100:00100000:3.0:1787367542.743854:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00100000:3.0:1787367542.743867:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:10551:x1874190425705472:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:3.0:1787367542.743961:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787367542.744000:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f3e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b57 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.744029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3e75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b50 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.744065:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.744071:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367542.746159:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.746410:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.746428:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367542.746599:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787367542.746636:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd27956e reply state 0000000036ffcf95 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.746647:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367542.746955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:10551:x1874190425705472:12345-192.168.204.23@tcp:36:bash.0 Request processed in 3083us (3758us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787367542.746968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 105 00000020:00080000:3.0:1787367542.746974:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787367542.755379:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755412:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755420:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755427:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367542.755433:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755441:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755462:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367542.755466:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367542.755472:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.755478:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3e9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367542.757941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.758864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425705600 00000100:00100000:2.0:1787367542.758877:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425705600 00000100:00100000:2.0:1787367542.758996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 106 00000100:00100000:2.0:1787367542.759008:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:10551:x1874190425705600:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367542.759038:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367542.759064:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3ea6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759174:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759216:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759230:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367542.759265:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787367542.759269:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367542.759290:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759334:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3ea6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759357:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.759367:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367542.759389:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367542.759404:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:2.0:1787367542.759484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:10551:x1874190425705600:12345-192.168.204.23@tcp:101:bash.0 Request processed in 478us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367542.759492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 106 00000100:00100000:1.0:1787367542.766646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.767052:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425705856 00000100:00100000:0.0:1787367542.767067:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425705856 00000100:00100000:0.0:1787367542.767156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1787367542.767169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:10551:x1874190425705856:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:0.0:1787367542.767765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+53:10551:x1874190425705856:12345-192.168.204.23@tcp:35:bash.0 Request processed in 595us (1134us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787367542.768241:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1787367542.819414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.819819:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425705984 00000100:00100000:2.0:1787367542.819833:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425705984 00000100:00100000:2.0:1787367542.819922:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 107 00000100:00100000:2.0:1787367542.819939:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+53:10557:x1874190425705984:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367542.819980:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367542.820012:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b65 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820107:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820125:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820138:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367542.820282:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787367542.820287:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367542.820323:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820353:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f3eb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b65 expref: 55 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820419:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b65 expref: 54 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.820429:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367542.820432:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367542.820436:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367542.820528:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425705984:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 593us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367542.820537:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 107 00000100:00100000:1.0:1787367542.824098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.824359:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425706112 00000100:00100000:3.0:1787367542.824374:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425706112 00000100:00100000:3.0:1787367542.824463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:3.0:1787367542.824477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425706112:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367542.824508:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367542.824603:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3ec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824745:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824759:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824778:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824786:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824794:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824938:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824947:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.824954:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367542.825002:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787367542.825009:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367542.825032:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825067:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825074:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825081:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825087:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.825093:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825101:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825115:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:3.0:1787367542.825118:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.825124:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825131:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825147:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825154:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825166:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825172:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367542.825175:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825182:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825217:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f91b61900) 00010000:00010000:3.0:1787367542.825220:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367542.825225:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825407:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3ec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b6c expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825423:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b6c expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.825432:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.825434:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367542.825438:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367542.825632:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10557:x1874190425706112:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1157us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.825654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:1.0:1787367542.830772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367542.830864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367542.830961:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425706496 00000100:00100000:0.0:1787367542.830974:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425706496 00000100:00100000:0.0:1787367542.831115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367542.831128:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:2357:x1874190425706496:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367542.831150:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367542.831216:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f3ed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b6c expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367542.831264:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367542.831272:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367542.831352:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:2357:x1874190425706496:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 227us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367542.831361:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367542.833808:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425706368 00000100:00100000:3.0:1787367542.833831:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425706368 00000100:00100000:3.0:1787367542.834031:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:3.0:1787367542.834046:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425706368:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367542.834077:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367542.834109:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3ede lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b73 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.834611:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.834636:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.834647:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.834704:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.834723:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 55 pid: 5841 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.834739:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3888380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446692224:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367542.834884:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367542.838727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367542.839069:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425706624 00000100:00100000:2.0:1787367542.839082:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425706624 00010000:00010000:2.0:1787367542.839142:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 56 pid: 5841 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367542.839232:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:2.0:1787367542.839262:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:2356:x1874190425706624:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367542.839286:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367542.839296:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 56 pid: 5841 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.839314:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 56 pid: 5841 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.839350:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367542.839356:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.839388:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.839408:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.839435:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367542.839523:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:2356:x1874190425706624:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 279us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367542.839543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00010000:00010000:3.0:1787367542.840787:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b5e expref: 55 pid: 5841 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367542.840831:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3888380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446692224:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367542.840867:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.840880:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.840887:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367542.840923:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787367542.841163:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3ede lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 56 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.842524:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 55 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.842667:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.842671:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787367542.842676:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e200, rc 0) 00000100:00100000:2.0:1787367542.842902:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10557:x1874190425706368:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 8855us (12144us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787367542.842913:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:0.0:1787367542.847450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367542.847561:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425706880 00000100:00100000:1.0:1787367542.847574:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425706880 00000100:00100000:1.0:1787367542.847657:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1787367542.847669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10557:x1874190425706880:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:1.0:1787367542.847692:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367542.847730:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f3e44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b49 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367542.847755:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:1.0:1787367542.847762:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367542.847847:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425706880:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 179us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367542.847856:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1787367542.851782:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446692352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367542.851859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367542.852053:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446692352 00000100:00100000:1.0:1787367542.852063:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446692352 00000100:00100000:0.0:1787367542.852217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367542.852400:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787367542.852444:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874190446692352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367542.852515:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367542.852603:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874190446692352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367542.852611:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787367542.852727:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446692352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787367542.852887:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367542.852905:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707008 00000100:00100000:2.0:1787367542.852910:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707008 00000100:00100000:2.0:1787367542.852964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00100000:2.0:1787367542.852972:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425707008:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:2.0:1787367542.853098:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.853122:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367542.853136:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367542.853446:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787367542.853557:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425707008:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 584us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367542.853577:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00100000:1.0:1787367542.857681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367542.857829:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707136 00000100:00100000:3.0:1787367542.857842:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707136 00000100:00100000:3.0:1787367542.857922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 111 00000100:00100000:3.0:1787367542.857935:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:10557:x1874190425707136:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367542.857984:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367542.858025:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858107:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858119:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858141:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858156:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858171:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367542.858175:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367542.858179:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367542.858188:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ea00, rc 0) 00000100:00100000:3.0:1787367542.858481:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10557:x1874190425707136:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 546us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367542.858490:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 111 00000040:00080000:0.0:1787367543.237401:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367543.237418:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367543.237498:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787367543.237511:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367543.237689:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae77800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446692480:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787367543.239228:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367543.255964:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae77800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446692480:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787367543.259106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.261483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707264 00000100:00100000:2.0:1787367543.261504:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707264 00000100:00100000:2.0:1787367543.261644:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:2.0:1787367543.261657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10558:x1874190425707264:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367543.261709:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367543.261880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10558:x1874190425707264:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 224us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.261889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00080000:0.0:1787367543.262103:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367543.272088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.272250:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707392 00000100:00100000:3.0:1787367543.272275:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707392 00000100:00100000:3.0:1787367543.272348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:3.0:1787367543.272392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10558:x1874190425707392:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787367543.272504:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272647:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272683:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272690:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272696:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272724:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272733:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272740:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367543.272873:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787367543.272879:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367543.272897:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272924:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272930:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272940:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272947:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367543.272952:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272961:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:3.0:1787367543.272982:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367543.272989:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.272996:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273013:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273021:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273026:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273038:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367543.273041:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273048:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9e8f91b61900) 00010000:00010000:3.0:1787367543.273059:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367543.273063:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273068:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3f08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273087:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273093:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273100:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273106:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367543.273109:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273115:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273134:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367543.273136:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367543.273140:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.273146:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f3f0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.274821:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10558:x1874190425707392:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 2426us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367543.274838:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:1.0:1787367543.279001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.279187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707648 00000100:00100000:2.0:1787367543.279257:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707648 00000100:00100000:2.0:1787367543.279334:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1787367543.279345:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:10558:x1874190425707648:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367543.279375:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367543.279412:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3f16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.279676:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.279700:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.279718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367543.279734:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787367543.280091:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280102:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280110:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280117:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.280123:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280132:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280146:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367543.280150:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367543.280155:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.280162:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f3f1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.286953:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3f16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b81 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.286986:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:2.0:1787367543.286989:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367543.286996:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f3f16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b81 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.287046:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74a00, rc 0) 00000100:00100000:2.0:1787367543.287153:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425707648:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 7807us (8170us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787367543.287165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:1.0:1787367543.304946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.305138:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425707776 00000100:00100000:0.0:1787367543.305151:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425707776 00000100:00100000:1.0:1787367543.305514:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:1.0:1787367543.305538:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425707776:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787367543.305593:0:6718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787367543.305745:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425707776:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 220us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367543.305753:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:3.0:1787367543.309398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.309737:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708032 00000100:00100000:1.0:1787367543.309749:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708032 00000100:00100000:1.0:1787367543.309851:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:1.0:1787367543.309863:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425708032:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367543.309890:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367543.309895:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787367543.309932:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f3ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b65 expref: 56 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.309955:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367543.309977:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367543.309996:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b88 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367543.310854:0:6718:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787367543.311136:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.311154:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.311166:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.312667:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b88 expref: 58 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.312703:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b88 expref: 57 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.312714:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:1.0:1787367543.312718:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367543.312722:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5ec00, rc 0) 00000100:00100000:1.0:1787367543.312921:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:10558:x1874190425708032:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 3057us (3542us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787367543.312933:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1787367543.321589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.327360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708288 00000100:00100000:1.0:1787367543.327400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708288 00000100:00100000:1.0:1787367543.327517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:1.0:1787367543.327820:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:10558:x1874190425708288:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367543.327919:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367543.327954:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b88 expref: 57 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.327981:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:1.0:1787367543.327995:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367543.328025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.328465:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.328615:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330226:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330258:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330272:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330402:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330411:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330419:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330444:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367543.330450:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330459:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330476:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:1.0:1787367543.330480:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367543.330486:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330494:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f3f40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330508:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330515:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330522:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330528:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367543.330531:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330538:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330559:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd42581b9 (ffff9e8f86d97600) 00010000:00010000:1.0:1787367543.330562:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367543.330565:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.330571:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3f47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd42581b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367543.330737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425708288:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 2917us (9222us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367543.330748:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1787367543.336236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.336645:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708416 00000100:00100000:1.0:1787367543.336661:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708416 00000100:00100000:1.0:1787367543.336792:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:1.0:1787367543.336806:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:10558:x1874190425708416:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367543.336835:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367543.336864:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b8f expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.336914:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.336932:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.336945:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.337086:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f3f4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 58 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.337120:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 57 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.337130:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:1.0:1787367543.337134:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367543.337139:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f800, rc 0) 00000100:00100000:1.0:1787367543.337271:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:10558:x1874190425708416:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 467us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367543.337279:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1787367543.339909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.341500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708672 00000100:00100000:0.0:1787367543.341536:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708672 00000100:00100000:0.0:1787367543.341644:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:0.0:1787367543.341658:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:10558:x1874190425708672:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367543.341787:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.341811:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.341826:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367543.342184:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787367543.342223:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348618030104ns, next at 349618025819ns, rc = 0 00000004:00010000:0.0:1787367543.342352:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ca2f775 reply state 0000000067876ded transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.342365:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367543.342525:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:10558:x1874190425708672:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 866us (2627us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787367543.342534:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00010000:00010000:2.0:1787367543.344698:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344723:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344734:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344740:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.344747:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344757:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344781:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:2.0:1787367543.344785:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367543.344792:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.344799:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f3f5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.345979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.346400:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708800 00000100:00100000:0.0:1787367543.346415:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708800 00000100:00100000:0.0:1787367543.346511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:0.0:1787367543.346800:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:10558:x1874190425708800:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367543.346868:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367543.346896:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.346980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.346999:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.347022:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:0.0:1787367543.347025:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367543.347030:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598a00, rc 0) 00000100:00100000:0.0:1787367543.347122:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:10558:x1874190425708800:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 598us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.347130:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:3.0:1787367543.350522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.350762:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425708928 00000100:00100000:1.0:1787367543.350777:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425708928 00000100:00100000:1.0:1787367543.350863:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367543.350876:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425708928:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787367543.352224:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425708928:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 1305us (1673us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787367543.352239:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1787367543.358068:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.358409:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425709184 00000100:00100000:0.0:1787367543.358422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425709184 00000100:00100000:0.0:1787367543.358586:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1787367543.358600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:10558:x1874190425709184:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787367543.363474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:10558:x1874190425709184:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 4857us (5476us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787367543.363495:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1787367543.383577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.384909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425709440 00000100:00100000:2.0:1787367543.384944:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425709440 00000100:00100000:2.0:1787367543.385272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:2.0:1787367543.385285:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:10558:x1874190425709440:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367543.385491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:10558:x1874190425709440:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 207us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.385501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:2.0:1787367543.390430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.390578:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425709568 00000100:00100000:0.0:1787367543.390592:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425709568 00000100:00100000:0.0:1787367543.390693:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:0.0:1787367543.390706:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:10558:x1874190425709568:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367543.390735:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367543.390761:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3f6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5b9d expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.391113:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.391132:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.391147:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367543.391232:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367543.391929:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.391978:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598200/0xcbf1f1bac53f3f6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b9d expref: 62 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.392611:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b9d expref: 61 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.392624:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:0.0:1787367543.392627:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787367543.392632:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599800, rc 0) 00000100:00100000:0.0:1787367543.392745:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:10558:x1874190425709568:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 2039us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.392772:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:2.0:1787367543.397100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.397873:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425709696 00000100:00100000:0.0:1787367543.397888:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425709696 00000100:00100000:0.0:1787367543.397965:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1787367543.397978:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2357:x1874190425709696:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367543.398014:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367543.398041:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ba4 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367543.398079:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a891077, blocks: 0x1 00010000:00010000:0.0:1787367543.398114:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1787367543.398121:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367543.398133:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.398157:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.398175:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598000, rc 0) 00000100:00100000:0.0:1787367543.398270:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2357:x1874190425709696:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 295us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.398278:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1787367543.406151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.411509:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425709952 00000100:00100000:3.0:1787367543.411540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425709952 00000100:00100000:2.0:1787367543.411899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:2.0:1787367543.411912:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:10558:x1874190425709952:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367543.412092:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:10558:x1874190425709952:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 182us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.412100:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1787367543.417998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.418358:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710080 00000100:00100000:1.0:1787367543.418372:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710080 00000100:00100000:1.0:1787367543.418450:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1787367543.418461:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f85bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:10558:x1874190425710080:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367543.418489:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367543.418517:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bab expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.418631:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.418652:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367543.418657:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367543.418664:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.418712:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.418729:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367543.418746:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446692608:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367543.418860:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367543.424419:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446692608:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367543.424477:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.424586:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e000, rc 0) 00000100:00100000:0.0:1787367543.424664:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f85bb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:10558:x1874190425710080:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 6203us (6679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.424677:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:0.0:1787367543.425659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.425793:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710208 00000100:00100000:0.0:1787367543.425803:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710208 00010000:00010000:0.0:1787367543.425847:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.425885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:0.0:1787367543.425896:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:2357:x1874190425710208:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367543.425914:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367543.425942:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.425958:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.425987:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ba4 expref: 11 pid: 6697 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.426006:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367543.426011:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367543.426491:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.426505:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.426621:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.426644:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446692736:192.168.204.23@tcp:105: 00000100:00100000:0.0:1787367543.426775:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa15c1900 going to sleep for 11 seconds 00010000:00010000:0.0:1787367543.429667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367543.433886:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446692736:192.168.204.23@tcp:105: 00010000:00010000:2.0:1787367543.433922:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367543.433995:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92391850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2357:x1874190425710208:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 8099us (8344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.434009:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1787367543.435915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.436064:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710336 00000100:00100000:3.0:1787367543.436076:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710336 00002000:00100000:3.0:1787367543.436150:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e8f90841500 x1874190425710336/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:184/0 lens 504/0 e 0 to 0 dl 1787367554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367543.436164:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f90841500 with x1874190425710336 ext(0->12) 00002000:00010000:3.0:1787367543.436171:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f90841500 00000100:00100000:3.0:1787367543.436241:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1787367543.436253:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2356:x1874190425710336:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787367543.437051:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:2356:x1874190425710336:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 795us (1144us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787367543.437062:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:3.0:1787367543.437071:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9e8f90841500 x1874190425710336/t4294967308(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:184/0 lens 504/448 e 0 to 0 dl 1787367554 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367543.437081:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f90841500 with x1874190425710336 ext(0->12) 00002000:00010000:3.0:1787367543.437085:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8f90841500 00000100:00100000:0.0:1787367543.439333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367543.439441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710464 00000100:00100000:1.0:1787367543.439455:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710464 00000100:00100000:1.0:1787367543.439534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:1.0:1787367543.439545:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:10558:x1874190425710464:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787367543.445299:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787367543.445351:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787367543.490375:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787367543.490416:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787367543.490471:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f850b7600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787367543.490478:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbac66400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f850b79c0 00000020:00080000:0.0:1787367543.490482:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbac66a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fbb25b800 00000004:00080000:0.0:1787367543.490600:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787367543.490629:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787367543.490646:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f88f10f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787367543.490650:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fa1e30100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f88f10780 00000020:00080000:0.0:1787367543.490653:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fb3311f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fafde2400 00000020:00080000:0.0:1787367543.490674:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787367543.490929:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787367543.491074:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446692864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787367543.491179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367543.492261:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446692864 00000100:00100000:0.0:1787367543.492276:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446692864 00000100:00100000:0.0:1787367543.492340:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367543.492352:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446692864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787367543.492397:0:8211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787367543.492444:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a891076, atime: 0x6a891076, ctime: 0x6a891076, blocks: 0xb 00010000:00010000:0.0:1787367543.492457:0:8211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.492478:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1787367543.492482:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367543.492490:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.492510:0:8211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.492532:0:8211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.492541:0:8211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.492565:0:8211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787367543.493244:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446692864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 891us (2061us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787367543.493255:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787367543.493361:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787367543.493367:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1787367543.493402:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fa0026680, transno 4294967301 00000004:00080000:0.0:1787367543.493411:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1787367543.493432:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e8fbae76300 x1874190446692864/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787367559 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787367543.493446:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fbae76300/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787367543.493452:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446692864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787367543.493911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446692992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787367543.493970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367543.494010:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367543.494018:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446693120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787367543.494045:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367543.494085:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446692992 00000100:00100000:3.0:1787367543.494094:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446692992 00000100:00100000:3.0:1787367543.494139:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446693120 00000100:00100000:3.0:1787367543.494142:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446693120 00000100:00100000:3.0:1787367543.494161:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367543.494171:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446692992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787367543.494214:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787367543.494256:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.494280:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 11 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.494289:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787367543.494293:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367543.494298:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.494346:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 11 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.494362:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 11 pid: 8211 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.494376:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446693248:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367543.494510:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787367543.494532:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446693120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787367543.494696:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787367543.494700:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787367543 00002000:00010000:0.0:1787367543.494702:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787367543.494704:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787367543 -> 1787367543 00002000:00010000:0.0:1787367543.494707:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787367543.494760:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874190446693120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 240us (713us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787367543.494899:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1787367543.494948:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb3888e00/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787367543.494954:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446693120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787367543.495067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10558:x1874190425710464:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 55522us (55747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367543.495078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00010000:00010000:2.0:1787367543.498972:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367543.498993:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.499009:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367543.499015:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.499056:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.499086:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.499100:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f578faf/0xcbf1f1bac53f3f86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.499505:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7900 going to sleep for 11 seconds 00010000:00010000:2.0:1787367543.500393:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367543.500395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:2.0:1787367543.500397:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367543.500402:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367543.500461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.500500:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710720 00000100:00100000:0.0:1787367543.500523:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710720 00000100:00100000:0.0:1787367543.500648:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1787367543.500659:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:2359:x1874190425710720:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787367543.500814:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710592 00000100:00100000:1.0:1787367543.500819:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710592 00010000:00010000:1.0:1787367543.500846:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 13 pid: 8211 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367543.500885:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1787367543.500893:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425710592:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367543.500906:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367543.500913:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 13 pid: 8211 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.500929:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 13 pid: 8211 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.500956:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367543.500962:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367543.500967:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.500978:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367543.501006:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367543.501488:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425710592:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 592us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367543.501508:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00010000:00010000:3.0:1787367543.501681:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f3d48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b0a expref: 12 pid: 8211 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.501699:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3888700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446693248:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367543.501727:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.501737:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.501743:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.501752:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.501771:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.501796:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787367543.502675:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1874190446692992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8499us (8698us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787367543.502687:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787367543.502840:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb388b800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787367543.502848:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446692992:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787367543.502927:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367543.502937:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.502948:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367543.502953:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.502964:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.502985:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.502992:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a419110/0xcbf1f1bac53f3f8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.503015:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367543.503016:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367543.503018:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787367543.539766:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1787367543.539795:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787367543.539807:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787367543.539814:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787367543.539988:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425710720:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 39323us (39519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.540003:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1787367543.543172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.543507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425710976 00000100:00100000:3.0:1787367543.543530:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425710976 00000100:00100000:3.0:1787367543.543608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:3.0:1787367543.543621:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10558:x1874190425710976:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367543.543699:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367543.543736:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f3f71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b9d expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.543760:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:3.0:1787367543.543766:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367543.543805:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.543824:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.543835:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367543.544603:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d175faa0 reply state 000000009023bd98 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.544636:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367543.544846:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:10558:x1874190425710976:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1225us (1689us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787367543.544854:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:3.0:1787367543.548118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.549624:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425711104 00000100:00100000:0.0:1787367543.549641:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425711104 00000100:00100000:0.0:1787367543.549768:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:0.0:1787367543.549781:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425711104:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787367543.550117:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787367543.550123:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787367543 -> 1787367542 00002000:00010000:0.0:1787367543.550125:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787367542 00002000:00010000:0.0:1787367543.550128:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787367543 -> 1787367542 00002000:00010000:0.0:1787367543.550130:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787367543.550233:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425711104:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 455us (2130us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787367543.550465:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00010000:00010000:2.0:1787367543.550587:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550600:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550608:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550616:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.550621:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550656:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550677:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:2.0:1787367543.550680:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367543.550686:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.550693:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3f94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.555619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.555735:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425711360 00000100:00100000:0.0:1787367543.555749:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425711360 00000100:00100000:0.0:1787367543.555875:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:0.0:1787367543.555889:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:10558:x1874190425711360:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787367543.556006:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.556042:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.556055:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.556103:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 15 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.556144:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 15 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.556166:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446693376:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367543.556332:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367543.559566:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.559790:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425711488 00000100:00100000:2.0:1787367543.559804:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425711488 00010000:00010000:2.0:1787367543.559864:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 16 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.559917:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:2.0:1787367543.559929:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:2357:x1874190425711488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367543.559948:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367543.559956:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 16 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.559973:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 16 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.560006:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:2.0:1787367543.560011:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.560040:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.560050:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.560076:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367543.560149:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:2357:x1874190425711488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 221us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.560158:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00010000:00010000:0.0:1787367543.560873:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f3f55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b8f expref: 15 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.560897:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446693376:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367543.560925:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560936:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560942:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560976:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560984:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560991:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.560999:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367543.561015:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.561025:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.561038:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:0.0:1787367543.561041:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787367543.561045:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.561053:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f3f9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.561120:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10558:x1874190425711360:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 5235us (5520us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787367543.561130:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:1.0:1787367543.563710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.563904:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425711616 00000100:00100000:3.0:1787367543.563919:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425711616 00000100:00100000:3.0:1787367543.563992:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1787367543.564004:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425711616:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787367543.564068:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.564093:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.564104:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367543.564109:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367543.564115:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.564160:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.564178:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 7 pid: 6696 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.564270:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446693504:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367543.564367:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367543.566584:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1874190446693504:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367543.566624:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367543.567801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.568152:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425711744 00000100:00100000:0.0:1787367543.568163:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425711744 00010000:00010000:0.0:1787367543.568233:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 8 pid: 6696 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.568287:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:0.0:1787367543.568298:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425711744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367543.568317:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367543.568365:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 8 pid: 6696 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.568391:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 8 pid: 6696 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.568422:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f3f7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bab expref: 8 pid: 6696 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.568445:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367543.568451:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367543.568458:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.568470:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.568524:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367543.568593:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425711744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 295us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.568602:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00010000:00010000:3.0:1787367543.568670:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568681:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568712:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568721:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568730:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568738:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367543.568743:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568753:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568777:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.568786:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f3fa2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.568836:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2359:x1874190425711616:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 4835us (5140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367543.568845:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1787367543.572009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.572139:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712000 00000100:00100000:2.0:1787367543.572151:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712000 00000100:00100000:2.0:1787367543.572270:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:2.0:1787367543.572281:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10558:x1874190425712000:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787367543.572392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572414:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572426:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572878:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572892:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572921:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572965:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.572983:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 15 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.573002:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafdeca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446693632:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367543.573285:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367543.576585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.576680:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712128 00000100:00100000:0.0:1787367543.576693:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712128 00010000:00010000:0.0:1787367543.576742:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 16 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.576792:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:0.0:1787367543.576803:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:2356:x1874190425712128:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367543.576839:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367543.576847:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 16 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.576863:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 16 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.576892:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:0.0:1787367543.576899:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.576911:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.576920:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.576943:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367543.577012:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+16:2356:x1874190425712128:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 210us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367543.577021:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00010000:00010000:3.0:1787367543.577286:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f3f63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b96 expref: 15 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.577306:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafdeca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446693632:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367543.577331:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.577342:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.577347:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367543.577616:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787367543.577806:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787367543.577858:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787367543.577958:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874190446693760:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787367543.578039:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367543.578070:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367543.578344:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446693760 00000100:00100000:1.0:1787367543.578353:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446693760 00000100:00100000:1.0:1787367543.578420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367543.578429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874190446693760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787367543.578524:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874190446693760:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367543.578533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367543.579939:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787367543.579952:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787367543.579975:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb3888e00, transno 4294967309 00000004:00080000:3.0:1787367543.580046:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb388b800, transno 4294967310 00000100:00100000:3.0:1787367543.581177:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874190446693760:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787367543.582105:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787367543.582433:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafded500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874190446693888:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787367543.582600:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367543.582713:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367543.582776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446693888 00000100:00100000:1.0:1787367543.582787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446693888 00000100:00100000:1.0:1787367543.582900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367543.582912:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1874190446693888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787367543.583188:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1874190446693888:12345-0@lo:1000:mdt00_001.0 Request processed in 267us (577us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787367543.583374:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafded500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5842:1874190446693888:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787367543.583429:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583441:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583451:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583458:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.583463:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583486:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583507:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f86d97700) 00010000:00010000:2.0:1787367543.583510:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367543.583586:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583595:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583635:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583642:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583648:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583654:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.583657:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583662:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583671:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367543.583673:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367543.583683:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583709:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583720:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.583756:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.583768:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafded880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446694016:192.168.204.23@tcp:105: 00000100:00100000:2.0:1787367543.583858:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367543.583937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367543.588769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.588857:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712256 00000100:00100000:3.0:1787367543.588870:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712256 00000100:00100000:3.0:1787367543.588947:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:3.0:1787367543.588960:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10557:x1874190425712256:12345-192.168.204.23@tcp:49:lfs.0 00000100:00100000:3.0:1787367543.589170:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:10557:x1874190425712256:12345-192.168.204.23@tcp:49:lfs.0 Request processed in 212us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367543.589180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1787367543.591618:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafded880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446694016:192.168.204.23@tcp:105: 00010000:00010000:2.0:1787367543.591661:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591673:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3ef3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591727:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591744:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591757:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591767:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591795:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591801:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591807:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.591812:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591819:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591832:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367543.591835:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367543.591839:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591845:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591856:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591862:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591868:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591873:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.591882:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591890:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591899:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367543.591901:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367543.591904:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.591910:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.593133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10558:x1874190425712000:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 19959us (20246us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787367543.593155:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 127 00000020:00080000:2.0:1787367543.593165:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787367543.593540:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367543.593547:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367543.594054:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787367543.594070:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367543.594914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.597022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712512 00000100:00100000:2.0:1787367543.597044:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712512 00000100:00100000:2.0:1787367543.597147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:2.0:1787367543.597161:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10557:x1874190425712512:12345-192.168.204.23@tcp:58:lfs.0 00000040:00080000:2.0:1787367543.598189:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787367543.598713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10557:x1874190425712512:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 1549us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.598726:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:3.0:1787367543.599145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.599318:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712768 00000100:00100000:3.0:1787367543.599328:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712768 00000100:00100000:3.0:1787367543.599388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:3.0:1787367543.599399:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:10558:x1874190425712768:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787367543.600130:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787367543.600272:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787367543.600329:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600351:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600365:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600396:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600403:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600410:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.600431:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787367543.600553:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10558:x1874190425712768:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 1153us (1407us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787367543.600564:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000020:00080000:3.0:1787367543.600571:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367543.600979:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367543.600988:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.600996:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367543.601010:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.601020:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.601035:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9e8f91b61c00) 00010000:00010000:0.0:1787367543.601038:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787367543.601043:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.601050:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f3fbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367543.601070:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367543.601072:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367543.601073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367543.632105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367543.632287:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425712896 00000100:00100000:2.0:1787367543.632302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425712896 00000100:00100000:2.0:1787367543.632397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:2.0:1787367543.632409:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:10561:x1874190425712896:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367543.632458:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367543.632486:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bb2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632590:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632609:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632624:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632642:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632650:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.632658:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.633038:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.633052:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 21 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.633063:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.633106:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 21 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.633132:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 21 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367543.633150:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafded880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446694144:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367543.635263:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367543.639001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367543.639460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425713152 00000100:00100000:0.0:1787367543.639473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425713152 00000100:00100000:0.0:1787367543.639564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1787367543.639577:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:5595:x1874190425713152:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787367543.639900:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:5595:x1874190425713152:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 325us (913us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787367543.639909:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1787367543.642163:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafded880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446694144:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367543.642402:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367543.642700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367543.642929:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425713280 00000100:00100000:3.0:1787367543.642939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425713280 00010000:00010000:3.0:1787367543.642982:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 23 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367543.643033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:3.0:1787367543.643044:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2356:x1874190425713280:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367543.643063:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367543.643091:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 23 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643104:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 23 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643146:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3ee5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5b73 expref: 23 pid: 6718 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643166:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367543.643172:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643184:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643715:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367543.643746:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367543.643820:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:2356:x1874190425713280:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 777us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367543.643829:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00010000:00010000:2.0:1787367543.645354:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645384:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367543.645454:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787367543.645459:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367543.645486:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645505:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645579:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645588:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645596:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645603:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.645630:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645639:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645657:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:2.0:1787367543.645661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367543.645666:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645673:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f3fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645692:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645699:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645705:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645711:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367543.645714:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645720:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645729:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9e8f829e0000) 00010000:00010000:2.0:1787367543.645732:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367543.645743:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645749:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f3fd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645806:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f3fc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb2 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645824:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb2 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367543.645831:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367543.645834:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367543.645836:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74400, rc 0) 00000100:00100000:2.0:1787367543.645972:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10561:x1874190425712896:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 13562us (13879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367543.645983:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 129 00010000:00010000:1.0:1787367544.453585:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367544.616594:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367544.616606:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367544.616656:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787367544.616664:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787367544.643903:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367544.643918:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367544.643986:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787367544.643995:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367544.644170:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafdedf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446694272:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367544.644344:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367544.650492:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafdedf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446694272:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367544.652505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367544.652596:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425713408 00000100:00100000:1.0:1787367544.652608:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425713408 00000100:00100000:1.0:1787367544.652696:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:1.0:1787367544.652710:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10572:x1874190425713408:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787367544.652792:0:6718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787367544.653842:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10572:x1874190425713408:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 1126us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367544.653855:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:1.0:1787367544.668301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367544.669248:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425713664 00000100:00100000:3.0:1787367544.669263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425713664 00000100:00100000:3.0:1787367544.669342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:3.0:1787367544.669373:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:10572:x1874190425713664:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367544.669402:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367544.669439:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3fe1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bb9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367544.669737:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3fe8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367544.669756:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367544.669767:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367544.669781:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787367544.669942:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f3fe1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb9 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367544.669962:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb9 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367544.669971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:3.0:1787367544.669974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367544.669978:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e200, rc 0) 00000100:00100000:3.0:1787367544.670074:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:10572:x1874190425713664:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 705us (1785us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787367544.670083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:3.0:1787367544.677632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367544.677692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367544.678271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425713920 00000100:00100000:1.0:1787367544.678287:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425713920 00000100:00100000:1.0:1787367544.678375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 132 00000100:00100000:1.0:1787367544.678389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:10572:x1874190425713920:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787367544.678501:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678526:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678539:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678796:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678806:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678814:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678821:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367544.678834:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678859:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:1.0:1787367544.678862:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367544.678867:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367544.678874:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f3ff6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367544.679082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10572:x1874190425713920:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 695us (1466us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787367544.679091:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 132 00000100:00100000:0.0:1787367544.679236:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714048 00000100:00100000:0.0:1787367544.679241:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714048 00000040:00080000:1.0:1787367544.679268:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367544.679273:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787367544.679296:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367544.679310:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:2359:x1874190425714048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367544.679332:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367544.679349:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f3fe8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb9 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367544.679372:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367544.679376:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367544.679396:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2359:x1874190425714048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 94us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367544.679403:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000040:00080000:1.0:1787367544.679771:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787367544.679780:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367544.686266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367544.686366:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714304 00000100:00100000:3.0:1787367544.686380:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714304 00000100:00100000:3.0:1787367544.686454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1787367544.686467:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:10572:x1874190425714304:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787367544.686803:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10572:x1874190425714304:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 338us (553us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787367544.686812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:0.0:1787367545.477775:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367545.923397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367545.923424:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafdedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446694400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367545.923506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367545.923574:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446694528:0@lo:400:kworker.0 00000100:00100000:2.0:1787367545.923616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367545.923639:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446695040:0@lo:400:kworker.0 00000100:00100000:2.0:1787367545.923662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367545.923677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367545.923698:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446694656:0@lo:400:kworker.0 00000100:00100000:1.0:1787367545.923733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367545.923755:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367545.923760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446694784:0@lo:400:kworker.0 00000100:00100000:1.0:1787367545.923782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367545.923814:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446694528 00000100:00100000:1.0:1787367545.923820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446694528 00000100:00100000:1.0:1787367545.923869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787367545.923878:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446694528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.923925:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446694400 00000100:00100000:3.0:1787367545.923929:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446694400 00000100:00100000:3.0:1787367545.923975:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367545.923981:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446694400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367545.924020:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367545.924066:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446694400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367545.924073:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367545.924096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695040 00000100:00100000:3.0:1787367545.924099:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695040 00000100:00100000:3.0:1787367545.924126:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446694656 00000100:00100000:3.0:1787367545.924130:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446694656 00000100:00100000:3.0:1787367545.924142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446694784 00000100:00100000:3.0:1787367545.924144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446694784 00000100:00100000:3.0:1787367545.924158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787367545.924164:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446694912:0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.924165:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446695040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.924223:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446695040:12345-0@lo:400:kworker.0 Request processed in 60us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367545.924230:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787367545.924241:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787367545.924254:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446694656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.924286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446694656:12345-0@lo:400:kworker.0 Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367545.924292:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787367545.924304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787367545.924309:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446694784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.924345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446694784:12345-0@lo:400:kworker.0 Request processed in 36us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367545.924351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1787367545.924370:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367545.924374:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367545.924403:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446694784:0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.924412:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446694656:0@lo:400:kworker.0 00000100:00100000:1.0:1787367545.925451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446694528:12345-0@lo:400:kworker.0 Request processed in 1571us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367545.925460:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787367545.925504:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367545.925538:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446694528:0@lo:400:kworker.0 00000100:00100000:2.0:1787367545.925552:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446695040:0@lo:400:kworker.0 00000100:00100000:2.0:1787367545.925569:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafdedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446694400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367545.925777:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446694912 00000100:00100000:3.0:1787367545.925783:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446694912 00000100:00100000:3.0:1787367545.925836:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787367545.925843:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446694912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367545.925882:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446694912:12345-0@lo:400:kworker.0 Request processed in 40us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367545.925888:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787367545.925910:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367545.925913:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446694912:0@lo:400:kworker.0 00000040:00080000:2.0:1787367546.472792:0:12103:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367546.472802:0:12103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367546.472846:0:12103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787367546.472854:0:12103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787367546.502810:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367546.636511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367546.636803:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714560 00000100:00100000:1.0:1787367546.636818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714560 00000100:00100000:1.0:1787367546.636913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:1.0:1787367546.636927:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:10593:x1874190425714560:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367546.636964:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367546.636993:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3ffd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bc0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367546.637139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f4004 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367546.637161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f4004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367546.637175:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f4004 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367546.637188:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787367546.637382:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f3ffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc0 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367546.637403:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f4004 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc0 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367546.637412:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:1.0:1787367546.637431:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787367546.637435:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5ec00, rc 0) 00000100:00100000:1.0:1787367546.637499:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10593:x1874190425714560:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 576us (1005us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787367546.637507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00080000:2.0:1787367546.637600:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367546.652111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367546.652613:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714688 00000100:00100000:2.0:1787367546.652624:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714688 00000100:00100000:2.0:1787367546.652714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:2.0:1787367546.652724:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10593:x1874190425714688:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367546.652811:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652833:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652868:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652895:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652902:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652909:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652916:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367546.652920:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652928:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652939:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:2.0:1787367546.652942:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367546.652946:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.652953:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75a00/0xcbf1f1bac53f4012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367546.653032:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:10593:x1874190425714688:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 309us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367546.653039:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:0.0:1787367546.777721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367546.777885:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714816 00000100:00100000:2.0:1787367546.777910:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714816 00000100:00100000:2.0:1787367546.777995:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:2.0:1787367546.778006:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425714816:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1787367546.778027:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367546.778053:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775306a8/0xcbf1f1bac53f4019 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bc7 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367546.778084:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a891076, atime: 0x6a891076, ctime: 0x6a891076, blocks: 0xb 00010000:00010000:2.0:1787367546.778106:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787367546.778110:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367546.778119:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775306a8/0xcbf1f1bac53f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc7 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.778139:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000775306a8/0xcbf1f1bac53f4019 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc7 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367546.778151:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75a00, rc 0) 00000100:00100000:2.0:1787367546.778262:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425714816:12345-192.168.204.23@tcp:101:cat.0 Request processed in 258us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367546.778270:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00080000:3.0:1787367546.778360:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367546.783029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367546.783121:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425714944 00000100:00100000:3.0:1787367546.783132:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425714944 00002000:00100000:3.0:1787367546.783245:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e8fbae75f80 x1874190425714944/t0(0) o3->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:187/0 lens 488/0 e 0 to 0 dl 1787367557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367546.783256:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbae75f80 with x1874190425714944 ext(0->4095) 00002000:00010000:3.0:1787367546.783261:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbae75f80 00000100:00100000:3.0:1787367546.783298:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:3.0:1787367546.783309:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425714944:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:3.0:1787367546.783974:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425714944:12345-192.168.204.23@tcp:3:cat.0 Request processed in 663us (954us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787367546.783982:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00002000:00100000:3.0:1787367546.783990:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9e8fbae75f80 x1874190425714944/t0(0) o3->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:187/0 lens 488/4536 e 0 to 0 dl 1787367557 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787367546.783999:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbae75f80 with x1874190425714944 ext(0->4095) 00002000:00010000:3.0:1787367546.784002:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbae75f80 00000100:00100000:1.0:1787367547.139333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367547.139386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367547.139427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367547.139465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367547.139514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367547.139550:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715456 00000100:00100000:0.0:1787367547.139550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715072 00000100:00100000:1.0:1787367547.139559:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715456 00000100:00100000:0.0:1787367547.139559:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715072 00000100:00100000:1.0:1787367547.139608:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715328 00000100:00100000:1.0:1787367547.139611:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715328 00000100:00100000:0.0:1787367547.139614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 288 00000100:00100000:0.0:1787367547.139625:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425715072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367547.139631:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:1.0:1787367547.139636:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425715456:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367547.139703:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425715072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367547.139710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 288 00000100:00100000:0.0:1787367547.139747:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1787367547.139755:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425715328:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367547.139862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715200 00000100:00100000:3.0:1787367547.139867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715200 00000100:00100000:3.0:1787367547.139897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715584 00000100:00100000:3.0:1787367547.139900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715584 00000100:00100000:2.0:1787367547.139916:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:3.0:1787367547.139922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:2.0:1787367547.139926:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:2356:x1874190425715200:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367547.139927:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425715584:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367547.139979:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425715456:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 342us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367547.139986:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00080000:1.0:1787367547.140015:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367547.140020:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367547.140158:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425715328:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 402us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367547.140177:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1787367547.149185:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:2356:x1874190425715200:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 9246us (9847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367547.149221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:3.0:1787367547.149270:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:2356:x1874190425715584:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 9337us (9751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367547.149280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 144 00010000:00010000:3.0:1787367547.526327:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367547.972532:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446695168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367547.972605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367547.972757:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695168 00000100:00100000:1.0:1787367547.972766:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695168 00000100:00100000:1.0:1787367547.972836:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787367547.972846:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446695168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367547.972886:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367547.972931:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446695168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367547.972947:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787367547.973029:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367547.973066:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446695168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787367548.548584:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787367548.555495:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787367548.558911:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:0.0:1787367548.558932:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787367548.558954:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787367548.558974:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8fba6c0c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787367548.558979:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fa615ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fba6c0780 00000020:00080000:0.0:1787367548.558982:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fa615a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f91687800 00000020:00080000:3.0:1787367548.559054:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787367548.559306:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787367549.053877:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787367549.053913:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:0.0:1787367549.571509:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367550.599887:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367551.043571:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446695680:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.043646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367551.043702:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787367551.043709:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446695296:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.043738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367551.043769:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446695808:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.043782:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695296 00000100:00100000:1.0:1787367551.043791:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695296 00000100:00100000:3.0:1787367551.043808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367551.043851:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446695424:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.043852:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787367551.043865:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446695296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.043881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367551.043904:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446695936:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.043926:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446695296:12345-0@lo:400:kworker.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367551.043937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787367551.043938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367551.043972:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695808 00000100:00100000:3.0:1787367551.043976:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367551.043976:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695808 00000100:00100000:3.0:1787367551.043985:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446695552:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367551.044113:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695680 00000100:00100000:3.0:1787367551.044118:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695680 00000100:00100000:3.0:1787367551.044148:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695936 00000100:00100000:3.0:1787367551.044151:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695936 00000100:00100000:3.0:1787367551.044185:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367551.044419:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446695680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044463:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446695680:12345-0@lo:400:kworker.0 Request processed in 271us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367551.044479:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367551.044500:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787367551.044506:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695424 00000100:00100000:3.0:1787367551.044508:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446695936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.044513:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695424 00000100:00100000:1.0:1787367551.044539:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446695552 00000100:00100000:1.0:1787367551.044542:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446695552 00000100:00100000:3.0:1787367551.044556:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446695936:12345-0@lo:400:kworker.0 Request processed in 49us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367551.044567:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787367551.044567:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787367551.044594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367551.044602:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446695424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044630:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446695424:12345-0@lo:400:kworker.0 Request processed in 30us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367551.044636:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787367551.044648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787367551.044653:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446695552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446695552:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367551.044681:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787367551.044720:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446695552:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044730:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446695424:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.044739:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787367551.044744:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fbae76300, transno 4294967304 00000100:00100000:3.0:1787367551.044755:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446695936:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.044792:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446695808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.044950:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446695808:12345-0@lo:400:kworker.0 Request processed in 374us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367551.044957:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787367551.044980:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367551.044983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367551.044986:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367551.045021:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446695296:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.045031:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446695808:0@lo:400:kworker.0 00000100:00100000:1.0:1787367551.045040:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787367551.045045:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787367551.045065:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446695680:0@lo:400:kworker.0 00000100:00100000:3.0:1787367551.046042:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446696064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367551.046090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367551.046124:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696064 00000100:00100000:1.0:1787367551.046130:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696064 00000100:00100000:1.0:1787367551.046858:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787367551.046868:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446696064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787367551.046900:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367551.047001:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446696064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367551.047009:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787367551.047491:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446696064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367551.349625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367551.349725:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715712 00000100:00100000:3.0:1787367551.349746:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715712 00000100:00100000:3.0:1787367551.349871:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00100000:3.0:1787367551.349895:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10246:x1874190425715712:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787367551.350050:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10246:x1874190425715712:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 Request processed in 169us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367551.350060:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00080000:1.0:1787367551.350150:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367551.355715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367551.355826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425715968 00000100:00100000:1.0:1787367551.355839:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425715968 00000100:00100000:1.0:1787367551.355917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:1.0:1787367551.355929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:10246:x1874190425715968:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367551.356621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:10246:x1874190425715968:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 690us (917us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787367551.356631:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:3.0:1787367551.619610:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367551.655568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367551.655914:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716096 00000100:00100000:1.0:1787367551.655928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716096 00000100:00100000:1.0:1787367551.656023:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00100000:1.0:1787367551.656033:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+5:11047:x1874190425716096:12345-192.168.204.23@tcp:101:lsof.0 00010000:00010000:1.0:1787367551.656063:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367551.656090:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bce expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656259:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656280:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656294:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367551.656567:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787367551.656571:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367551.656698:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656732:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656754:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367551.656765:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:1.0:1787367551.656768:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367551.656778:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e000, rc 0) 00000100:00100000:1.0:1787367551.656871:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+6:11047:x1874190425716096:12345-192.168.204.23@tcp:101:lsof.0 Request processed in 838us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367551.656879:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00080000:3.0:1787367551.657736:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787367551.876248:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367551.876262:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367551.876344:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787367551.876352:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367552.262149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367552.262273:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716352 00000100:00100000:3.0:1787367552.262274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367552.262286:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716352 00000100:00100000:3.0:1787367552.262311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367552.262345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367552.262363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:2.0:1787367552.262373:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2357:x1874190425716352:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367552.262462:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2357:x1874190425716352:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367552.262470:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:3.0:1787367552.262716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367552.262789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716224 00000100:00100000:2.0:1787367552.262794:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716224 00000100:00100000:2.0:1787367552.262819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 290 00000100:00100000:2.0:1787367552.262825:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425716224:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367552.262855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425716224:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367552.262861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 290 00000100:00100000:3.0:1787367552.270317:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716736 00000100:00100000:3.0:1787367552.270333:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716736 00000100:00100000:0.0:1787367552.270532:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:0.0:1787367552.270548:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425716736:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367552.270642:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425716736:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 99us (7939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367552.270650:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:1.0:1787367552.273233:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716608 00000100:00100000:1.0:1787367552.273252:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716608 00000100:00100000:1.0:1787367552.273363:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716480 00000100:00100000:1.0:1787367552.273368:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716480 00000100:00080000:3.0:1787367552.273587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787367552.273593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367552.273660:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:1.0:1787367552.273673:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425716608:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367552.273716:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:2.0:1787367552.273731:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425716480:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367552.273841:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425716608:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 169us (11565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367552.273849:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:2.0:1787367552.287331:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425716480:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 13591us (24970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367552.287349:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00010000:00010000:0.0:1787367552.643459:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367553.093369:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787367553.093398:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446696192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367553.093474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367553.093756:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696192 00000100:00100000:1.0:1787367553.093765:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696192 00000100:00100000:1.0:1787367553.093835:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787367553.093846:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446696192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367553.093890:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367553.093952:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446696192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367553.093959:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787367553.094023:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367553.094464:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446696192:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787367553.651603:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787367553.651626:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787367553.651746:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787367553.651758:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787367553.667483:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367554.691477:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367555.721788:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787367555.767927:0:12307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:59:14 (1787367554) 00000100:00100000:3.0:1787367556.166024:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446696448:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.166160:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367556.166257:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446696960:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.166305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367556.166340:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787367556.166346:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa0024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446696576:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.166373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367556.166391:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446697088:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.166418:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367556.166459:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696448 00000100:00100000:3.0:1787367556.166468:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696448 00000100:00100000:3.0:1787367556.166543:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787367556.166554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446696448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.166926:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446696448:12345-0@lo:400:kworker.0 Request processed in 372us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367556.166936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787367556.166993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696960 00000100:00100000:3.0:1787367556.166997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696960 00000100:00100000:3.0:1787367556.167037:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696576 00000100:00100000:3.0:1787367556.167041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696576 00000100:00100000:3.0:1787367556.167063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787367556.167070:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446696960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167110:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446696960:12345-0@lo:400:kworker.0 Request processed in 41us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367556.167117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787367556.167142:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787367556.167149:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446696576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446696576:12345-0@lo:400:kworker.0 Request processed in 76us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367556.167232:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787367556.167257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446697088 00000100:00100000:3.0:1787367556.167260:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446697088 00000100:00100000:3.0:1787367556.167307:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787367556.167313:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446697088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167342:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446697088:12345-0@lo:400:kworker.0 Request processed in 30us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367556.167348:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787367556.167367:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367556.167372:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367556.167418:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446696576:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167430:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446697088:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167440:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa0026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446696448:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.167450:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f9080f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446696960:0@lo:400:kworker.0 00000100:00100000:2.0:1787367556.167660:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446696704:0@lo:400:kworker.0 00000100:00100000:2.0:1787367556.167698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367556.167730:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787367556.167736:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446696320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367556.167774:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367556.167797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446696832:0@lo:400:kworker.0 00000100:00100000:2.0:1787367556.167834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367556.167867:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696320 00000100:00100000:2.0:1787367556.167871:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696320 00000100:00100000:2.0:1787367556.167901:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787367556.167909:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446696320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367556.167946:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367556.168001:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446696320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367556.168008:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787367556.168027:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696832 00000100:00100000:2.0:1787367556.168030:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696832 00000100:00100000:2.0:1787367556.168061:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367556.168068:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446696832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367556.168100:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446696832:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367556.168106:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787367556.168150:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367556.168180:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446696320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367556.168223:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446696832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.169094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446696704 00000100:00100000:3.0:1787367556.169102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446696704 00000100:00100000:3.0:1787367556.169172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787367556.169180:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446696704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367556.169283:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446696704:12345-0@lo:400:kworker.0 Request processed in 104us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367556.169290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787367556.169332:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446696704:0@lo:400:kworker.0 00000100:00080000:2.0:1787367556.169918:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787367556.739650:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367557.387660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367557.387712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367557.387753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367557.387792:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717120 00000100:00100000:3.0:1787367557.387803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367557.387812:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717120 00000100:00100000:3.0:1787367557.387846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367557.387898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717376 00000100:00100000:3.0:1787367557.387907:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717376 00000100:00100000:1.0:1787367557.387926:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717248 00000100:00100000:1.0:1787367557.387933:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717248 00000100:00100000:3.0:1787367557.387975:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716992 00000100:00100000:3.0:1787367557.387981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716992 00000100:00100000:1.0:1787367557.387993:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:1.0:1787367557.388009:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425717120:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367557.388025:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:3.0:1787367557.388039:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425717376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367557.388144:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425717120:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367557.388158:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:0.0:1787367557.388181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425716864 00000100:00100000:0.0:1787367557.388188:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425716864 00000100:00100000:1.0:1787367557.388231:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:1.0:1787367557.388245:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425717248:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367557.388291:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 292 00000100:00100000:0.0:1787367557.388306:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425716864:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367557.388393:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:2.0:1787367557.388404:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425716992:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367557.390290:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425717376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 2242us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367557.390305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00080000:3.0:1787367557.390587:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367557.390593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367557.390596:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367557.395514:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425717248:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 7126us (7522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367557.395537:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:2.0:1787367557.396264:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425716992:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 7838us (8440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367557.396280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:0.0:1787367557.397055:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2357:x1874190425716864:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 8747us (9399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367557.397066:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 292 00000100:00100000:3.0:1787367557.487599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367557.487713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717632 00000100:00100000:0.0:1787367557.487727:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717632 00000100:00100000:0.0:1787367557.487803:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 137 00000100:00100000:0.0:1787367557.487812:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:11313:x1874190425717632:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367557.487833:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367557.487856:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f402e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.487938:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.487956:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.487966:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.487981:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.488005:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.488012:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.492725:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4043 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.492758:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.492771:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4043 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367557.492784:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787367557.492995:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493002:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493009:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493014:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367557.493018:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493025:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493048:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18200) 00010000:00010000:0.0:1787367557.493050:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367557.493056:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493061:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f4035 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493075:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493081:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493087:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493092:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367557.493095:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493101:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493121:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e8f83c18e00) 00010000:00010000:0.0:1787367557.493123:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367557.493126:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.493131:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f403c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367557.499258:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f402e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bd5 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367557.499305:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4043 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bd5 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367557.499317:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:1.0:1787367557.499320:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367557.499326:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:1.0:1787367557.500889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:11313:x1874190425717632:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 13062us (13292us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787367557.500903:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 137 00000100:00100000:3.0:1787367557.510838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367557.510952:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717760 00000100:00100000:0.0:1787367557.510968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717760 00000100:00100000:0.0:1787367557.511063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1787367557.511075:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:2356:x1874190425717760:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367557.511092:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367557.511128:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4043 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bd5 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367557.511166:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:0.0:1787367557.511173:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367557.511294:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92393c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:2356:x1874190425717760:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 222us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367557.511302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367557.511937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367557.512695:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425717888 00000100:00100000:3.0:1787367557.512712:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425717888 00000100:00100000:3.0:1787367557.512787:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:3.0:1787367557.512798:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:11313:x1874190425717888:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787367557.512939:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:11313:x1874190425717888:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 143us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367557.512946:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 138 00010000:00010000:3.0:1787367557.764245:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367558.020404:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367558.020414:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367558.020464:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787367558.020471:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367558.211400:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367558.211434:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446697216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367558.211586:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367558.213023:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446697216 00000100:00100000:0.0:1787367558.213398:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446697216 00000100:00080000:3.0:1787367558.213526:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367558.213668:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367558.213679:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446697216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367558.213721:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367558.213803:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446697216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367558.213811:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787367558.213895:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446697216:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787367558.755620:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1787367558.787937:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367559.669323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367559.669665:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718016 00000100:00100000:2.0:1787367559.669676:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718016 00000100:00100000:2.0:1787367559.669744:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:2.0:1787367559.669756:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:11355:x1874190425718016:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367559.669778:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367559.669799:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bdc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669865:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669881:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669892:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669904:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.669916:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670247:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670256:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670263:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670269:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367559.670274:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670282:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670294:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:2.0:1787367559.670297:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.670302:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670308:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670318:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670324:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670330:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670341:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367559.670344:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670350:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670358:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e8f890a8200) 00010000:00010000:2.0:1787367559.670361:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.670363:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670369:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f405f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670399:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4051 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bdc expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670410:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:2.0:1787367559.670412:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.670416:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bdc expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.670424:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74200, rc 0) 00000100:00100000:2.0:1787367559.670479:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:11355:x1874190425718016:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 726us (1165us total) trans 0 rc 301/301 00000100:00100000:2.0:1787367559.670488:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00080000:0.0:1787367559.670885:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367559.677100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.677555:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718272 00000100:00100000:3.0:1787367559.677567:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718272 00000100:00100000:3.0:1787367559.677635:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 140 00000100:00100000:3.0:1787367559.677645:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:11355:x1874190425718272:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1787367559.677715:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367559.677750:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f39cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a15 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.677768:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:3.0:1787367559.677775:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367559.678339:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.678360:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.678370:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.678409:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.678501:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 5 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.678526:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446697344:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367559.678628:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367559.686184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.686234:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718400 00000100:00100000:3.0:1787367559.686243:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718400 00010000:00010000:3.0:1787367559.686300:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 6 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.686332:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:3.0:1787367559.686340:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425718400:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367559.686357:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367559.686363:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 6 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.686378:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 6 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.686404:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:3.0:1787367559.686410:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.686420:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.686786:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.686817:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367559.686874:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f87302e6-9d75-459a-a851-9ecd89807cda+6:2357:x1874190425718400:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 533us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367559.686883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00080000:3.0:1787367559.686911:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367559.687336:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bce expref: 5 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.687351:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446697344:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367559.687371:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.687382:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.687388:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.687411:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.687423:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.687542:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367559.691774:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787367559.691797:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691815:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691823:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691830:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367559.691834:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691843:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691865:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:3.0:1787367559.691868:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367559.691874:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.691882:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4066 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367559.691905:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4576cca reply state 0000000045d9b796 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.691915:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367559.692173:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:11355:x1874190425718272:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 14522us (15077us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787367559.692182:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 140 00010000:00010000:0.0:1787367559.695327:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695366:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695375:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695381:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367559.695386:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695396:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695415:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e8f91b61000) 00010000:00010000:0.0:1787367559.695418:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367559.695423:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367559.695722:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f406d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.774689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367559.774823:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718528 00000100:00100000:2.0:1787367559.774845:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718528 00000100:00100000:2.0:1787367559.774903:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 141 00000100:00100000:2.0:1787367559.774911:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:11363:x1874190425718528:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:2.0:1787367559.774934:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367559.774959:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5be3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775027:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775050:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775076:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367559.775138:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787367559.775143:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367559.775170:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775237:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5be3 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775256:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5be3 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.775265:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367559.775268:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367559.775271:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74a00, rc 0) 00000100:00100000:2.0:1787367559.775335:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:11363:x1874190425718528:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 424us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367559.775342:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 141 00010000:00010000:1.0:1787367559.812345:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367559.832312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367559.832434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718656 00000100:00100000:2.0:1787367559.832449:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718656 00000100:00100000:2.0:1787367559.832514:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 142 00000100:00100000:2.0:1787367559.832524:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+14:11369:x1874190425718656:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367559.832546:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367559.832568:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832643:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832657:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832668:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832680:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832686:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.832693:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833435:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833464:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833472:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367559.833514:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787367559.833518:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367559.833620:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833633:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833640:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833646:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833652:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367559.833656:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833663:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833675:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367559.833678:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.833682:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833699:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833716:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833722:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833728:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833732:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367559.833735:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833740:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367559.833750:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.833752:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833757:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833795:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bea expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833811:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bea expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.833824:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367559.833826:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787367559.833829:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74800, rc 0) 00000100:00100000:2.0:1787367559.833912:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:11369:x1874190425718656:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1388us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367559.833987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 142 00000100:00100000:0.0:1787367559.839147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367559.839864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425718912 00000100:00100000:1.0:1787367559.839875:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425718912 00000100:00100000:1.0:1787367559.840052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:1.0:1787367559.840102:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+15:11369:x1874190425718912:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1787367559.840124:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367559.840148:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f409e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840330:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840368:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840545:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840580:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.840595:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787367559.841555:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787367559.841793:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841808:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841819:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841865:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841872:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841881:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367559.841902:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841910:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841926:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367559.841929:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367559.841935:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.841942:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f40a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367559.841959:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de40689 reply state 00000000cca5bebb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367559.841971:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787367559.842014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f409e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.842031:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367559.842038:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:1.0:1787367559.842041:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367559.842043:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f200, rc 0) 00000100:00100000:1.0:1787367559.842177:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11369:x1874190425718912:12345-192.168.204.23@tcp:101:bash.0 Request processed in 2115us (3038us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787367559.842249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 143 00010000:00010000:2.0:1787367559.845571:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845591:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845599:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845607:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367559.845612:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845636:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845656:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97c00) 00010000:00010000:2.0:1787367559.845659:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367559.845665:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.845671:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f40ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367559.847003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.847094:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425719040 00000100:00100000:3.0:1787367559.847116:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425719040 00000100:00100000:3.0:1787367559.847264:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:3.0:1787367559.847275:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2356:x1874190425719040:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367559.847499:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367559.847522:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bf8 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787367559.847548:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367559.847568:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787367559.847572:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367559.847581:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 6 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.847600:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 6 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.847614:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f000, rc 0) 00000100:00100000:3.0:1787367559.847686:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425719040:12345-192.168.204.23@tcp:101:bash.0 Request processed in 413us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367559.847693:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00080000:0.0:1787367559.850619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367559.851724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.851849:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425719168 00000100:00100000:3.0:1787367559.851859:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425719168 00000100:00100000:3.0:1787367559.851967:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1787367559.851978:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:11369:x1874190425719168:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367559.851995:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367559.852012:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5bff expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.852068:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.852077:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367559.852082:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367559.852087:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.852128:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.852141:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.852155:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446697472:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367559.852282:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367559.855423:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446697472:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367559.855464:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.855485:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367559.855596:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:11369:x1874190425719168:12345-192.168.204.23@tcp:101:bash.0 Request processed in 3618us (3880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367559.855616:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1787367559.858723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.859650:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425719296 00000100:00100000:3.0:1787367559.859661:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425719296 00010000:00010000:3.0:1787367559.859703:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.859913:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1787367559.859935:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425719296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367559.859952:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367559.859974:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.859987:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.860021:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f40c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf8 expref: 7 pid: 8211 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.860039:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367559.860044:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367559.860053:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.860082:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367559.860121:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367559.860151:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1874190446697600:192.168.204.23@tcp:105: 00000100:00100000:3.0:1787367559.860415:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367559.867353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367559.867595:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1874190446697600:192.168.204.23@tcp:105: 00010000:00010000:3.0:1787367559.867622:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367559.867670:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425719296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 7738us (8958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367559.867681:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1787367559.869354:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425719552 00000100:00100000:1.0:1787367559.869369:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425719552 00000100:00100000:1.0:1787367559.869427:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1787367559.869437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:11369:x1874190425719552:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1787367559.869985:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11369:x1874190425719552:12345-192.168.204.23@tcp:35:bash.0 Request processed in 547us (2641us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787367559.869994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1787367559.982832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367559.983046:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425719808 00000100:00100000:2.0:1787367559.983067:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425719808 00000100:00100000:2.0:1787367559.983141:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:2.0:1787367559.983153:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11379:x1874190425719808:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367559.983187:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367559.983255:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367559.983393:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787367559.983519:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c06 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.983534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:2.0:1787367559.983537:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367559.983543:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c06 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367559.983555:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74200, rc 0) 00000100:00100000:2.0:1787367559.983610:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11379:x1874190425719808:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 460us (792us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787367559.983618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:0.0:1787367559.988484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367559.988695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720064 00000100:00100000:1.0:1787367559.988706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720064 00000100:00100000:1.0:1787367559.988780:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367559.988791:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11379:x1874190425720064:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1787367559.989111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11379:x1874190425720064:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 320us (638us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787367559.989119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1787367560.084720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.084837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720192 00000100:00100000:2.0:1787367560.084848:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720192 00000100:00100000:2.0:1787367560.084908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 145 00000100:00100000:2.0:1787367560.084919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11385:x1874190425720192:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367560.084944:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367560.084980:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c0d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085070:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085088:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085099:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367560.085169:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787367560.085173:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367560.085229:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c0d expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085274:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c0d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.085282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367560.085284:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367560.085287:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75200, rc 0) 00000100:00100000:2.0:1787367560.085350:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:11385:x1874190425720192:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 433us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367560.085365:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 145 00000100:00100000:0.0:1787367560.093653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.093797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720448 00000100:00100000:2.0:1787367560.094137:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720448 00000100:00100000:2.0:1787367560.094229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 146 00000100:00100000:2.0:1787367560.094240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:11385:x1874190425720448:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367560.094266:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367560.094289:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.094502:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f40f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.094518:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f40f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.094530:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f40f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367560.094543:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787367560.094683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f40eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c14 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.094703:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f40f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c14 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.094712:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367560.094715:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367560.094719:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367560.094796:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:11385:x1874190425720448:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 558us (1153us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787367560.094805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 146 00000100:00100000:0.0:1787367560.099130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.099361:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720576 00000100:00100000:3.0:1787367560.099372:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720576 00000100:00100000:3.0:1787367560.099441:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1787367560.099451:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:2359:x1874190425720576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367560.099468:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367560.099560:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f40f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c14 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.099579:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:3.0:1787367560.099585:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367560.099703:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:2359:x1874190425720576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 253us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367560.099712:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367560.101844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.102362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720832 00000100:00100000:2.0:1787367560.102371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720832 00000100:00100000:2.0:1787367560.102434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 147 00000100:00100000:2.0:1787367560.102444:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:11385:x1874190425720832:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367560.102470:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367560.102491:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c1b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.102600:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.102616:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.102626:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367560.102638:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787367560.102761:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c1b expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.102779:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c1b expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.102788:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367560.102791:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787367560.102794:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367560.102897:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11385:x1874190425720832:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 454us (1061us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787367560.102996:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 147 00000100:00100000:1.0:1787367560.108664:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.109030:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425720960 00000100:00100000:3.0:1787367560.109041:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425720960 00000100:00100000:3.0:1787367560.109138:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1787367560.109148:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425720960:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:3.0:1787367560.109318:0:8211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.109339:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.109348:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367560.109352:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367560.109356:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.109470:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.109486:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 6 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367560.109503:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446697728:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367560.109608:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367560.112912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367560.113016:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721088 00000100:00100000:1.0:1787367560.113031:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721088 00000100:00100000:3.0:1787367560.113075:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446697728:192.168.204.23@tcp:104: 00002000:00100000:1.0:1787367560.113093:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e8f908c4380 x1874190425721088/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:201/0 lens 504/0 e 0 to 0 dl 1787367571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787367560.113103:0:8211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787367560.113103:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908c4380 with x1874190425721088 ext(0->12) 00010000:00010000:1.0:1787367560.113111:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 7 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.113123:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 7 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367560.113149:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f908c4380 00000100:00100000:1.0:1787367560.113284:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1787367560.113295:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425721088:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:1.0:1787367560.113802:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425721088:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 507us (898us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787367560.113815:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:1.0:1787367560.113823:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9e8f908c4380 x1874190425721088/t4294967305(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:201/0 lens 504/448 e 0 to 0 dl 1787367571 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367560.113831:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f908c4380 with x1874190425721088 ext(0->12) 00010000:00010000:1.0:1787367560.113837:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.113848:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367560.113855:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f908c4380 00000100:00100000:0.0:1787367560.116297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.116415:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721216 00000100:00100000:2.0:1787367560.116425:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721216 00010000:00010000:2.0:1787367560.116465:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367560.116545:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1787367560.116556:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425721216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367560.116573:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787367560.116596:0:7633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787367560.116600:0:7633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787367560 00002000:00010000:2.0:1787367560.116602:0:7633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787367560 00002000:00010000:2.0:1787367560.116604:0:7633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787367560 00010000:00010000:2.0:1787367560.116610:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.116622:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.116647:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bac35b5/0xcbf1f1bac53f40c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bff expref: 9 pid: 6697 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.116664:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367560.116668:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367560.116672:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.116700:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.116745:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367560.116810:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425721216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 256us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367560.116818:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00010000:00010000:0.0:1787367560.116874:0:8211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116884:0:8211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116909:0:8211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116929:0:8211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116936:0:8211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116942:0:8211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367560.116947:0:8211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116955:0:8211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116978:0:8211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.116987:0:8211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125256af/0xcbf1f1bac53f4115 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367560.117043:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425720960:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 7896us (8391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367560.117062:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1787367560.119866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367560.120141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721472 00000100:00100000:1.0:1787367560.120153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721472 00000100:00100000:1.0:1787367560.120363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:1.0:1787367560.120376:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11385:x1874190425721472:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:1.0:1787367560.120445:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c1b expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367560.120722:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787367560.120790:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787367560.121572:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787367560.121643:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.121663:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.121672:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.121713:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.121731:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 28 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367560.121746:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90841c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874190446697856:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367560.121847:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367560.125512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367560.125574:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90841c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1874190446697856:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367560.125602:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721600 00010000:00010000:0.0:1787367560.125609:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367560.125611:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721600 00010000:00010000:3.0:1787367560.125650:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 29 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367560.125699:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:3.0:1787367560.125709:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2357:x1874190425721600:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367560.125728:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367560.125735:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 29 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125747:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 29 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125773:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f40b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5bf1 expref: 29 pid: 5841 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125789:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:3.0:1787367560.125794:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125803:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125810:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.125878:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367560.125964:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:2357:x1874190425721600:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 255us (464us total) trans 0 rc 0/0 00010000:00010000:0.0:1787367560.125965:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.125972:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367560.125974:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000001:00080000:0.0:1787367560.126368:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787367560.126912:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787367560.127040:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbaefea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446697984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787367560.127123:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367560.127160:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787367560.127383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446697984 00000100:00100000:1.0:1787367560.127392:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446697984 00000100:00100000:1.0:1787367560.127514:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787367560.127525:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446697984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367560.127626:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446697984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367560.127633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787367560.127661:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367560.127881:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbaefea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446697984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787367560.128616:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787367560.128694:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446698112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787367560.129122:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367560.129158:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367560.129247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446698112 00000100:00100000:1.0:1787367560.129255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446698112 00000100:00100000:1.0:1787367560.129320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787367560.129329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874190446698112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787367560.129567:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874190446698112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 239us (444us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787367560.129576:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367560.129780:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1874190446698112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787367560.129840:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787367560.129885:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129897:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129910:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129917:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367560.129922:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129930:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129947:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:3.0:1787367560.129950:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787367560.129956:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.129963:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f411c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367560.130490:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787367560.130624:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787367560.130639:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365406446450ns, next at 366406442760ns, rc = 0 00000001:00080000:2.0:1787367560.130647:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787367560.130691:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367560.130695:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787367560.130703:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4107 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c1b expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367560.130906:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11385:x1874190425721472:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 10532us (11047us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787367560.130916:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000020:00080000:2.0:1787367560.130922:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787367560.134518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.134722:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721728 00000100:00100000:3.0:1787367560.134755:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721728 00000100:00100000:3.0:1787367560.134882:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:3.0:1787367560.134896:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11385:x1874190425721728:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367560.134944:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367560.134980:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c22 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.135079:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c22 expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.135097:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c22 expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.135123:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:3.0:1787367560.135126:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367560.135130:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367560.135263:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11385:x1874190425721728:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 370us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367560.135271:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:0.0:1787367560.139833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.140108:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425721984 00000100:00100000:3.0:1787367560.140120:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425721984 00000100:00100000:3.0:1787367560.140185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:3.0:1787367560.140236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11385:x1874190425721984:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367560.140531:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:11385:x1874190425721984:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 297us (709us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787367560.140540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1787367560.237630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367560.238281:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425722240 00000100:00100000:0.0:1787367560.238297:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425722240 00000100:00100000:0.0:1787367560.238452:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:0.0:1787367560.238464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+33:11395:x1874190425722240:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367560.238493:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367560.238521:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f412a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c29 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367560.238652:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787367560.238779:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f412a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c29 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.238795:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367560.238798:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367560.238803:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f412a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c29 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.238816:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599c00, rc 0) 00000100:00100000:0.0:1787367560.238889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11395:x1874190425722240:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 427us (1273us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787367560.238897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:1.0:1787367560.242358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.243831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425722368 00000100:00100000:2.0:1787367560.243848:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425722368 00000100:00100000:2.0:1787367560.243922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 150 00000100:00100000:2.0:1787367560.243931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11395:x1874190425722368:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1787367560.244014:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244048:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244520:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244531:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244652:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244661:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244668:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787367560.244715:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244728:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244734:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244752:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244758:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.244762:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244770:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244783:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367560.244786:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367560.244790:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244797:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244813:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244819:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244824:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244828:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.244831:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244848:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244856:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367560.244858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367560.244862:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244868:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f413f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244883:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244888:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244893:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244898:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.244900:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.244906:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.246365:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367560.246370:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367560.246378:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.246403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367560.246714:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11395:x1874190425722368:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 2776us (4357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367560.246725:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 150 00000100:00100000:1.0:1787367560.251012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.251398:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425722624 00000100:00100000:3.0:1787367560.251436:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425722624 00000100:00100000:3.0:1787367560.251531:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1787367560.251543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11395:x1874190425722624:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367560.251821:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:11395:x1874190425722624:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 281us (819us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787367560.251830:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:1.0:1787367560.304911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.305686:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425722880 00000100:00100000:2.0:1787367560.305699:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425722880 00000100:00100000:2.0:1787367560.305831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 151 00000100:00100000:2.0:1787367560.305844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:11398:x1874190425722880:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367560.305874:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367560.305944:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f414d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306037:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306065:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306078:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306095:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306101:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306137:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306346:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306356:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306365:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367560.306376:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787367560.306507:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306516:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306524:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306531:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.306537:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306546:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306563:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367560.306566:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367560.306579:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306605:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306611:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306618:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306623:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.306626:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306633:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306641:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367560.306643:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367560.306646:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306652:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f415b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306709:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f414d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306742:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.306750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367560.306753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367560.306756:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74000, rc 0) 00000100:00100000:2.0:1787367560.306854:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11398:x1874190425722880:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1013us (1956us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787367560.306863:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 151 00000100:00100000:1.0:1787367560.311429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.311542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425723008 00000100:00100000:2.0:1787367560.311554:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425723008 00000100:00100000:2.0:1787367560.311868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 152 00000100:00100000:2.0:1787367560.311880:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11398:x1874190425723008:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367560.311962:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.311980:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.311993:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312025:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312032:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312078:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312085:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367560.312089:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312098:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312111:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367560.312114:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367560.312119:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367560.312126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367560.312337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11398:x1874190425723008:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 459us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367560.312345:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 152 00000100:00100000:1.0:1787367560.316691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367560.317658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425723264 00000100:00100000:2.0:1787367560.317670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425723264 00000100:00100000:2.0:1787367560.317732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1787367560.317741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11398:x1874190425723264:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367560.319513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:11398:x1874190425723264:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 1761us (2824us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787367560.319526:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:1.0:1787367560.694933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.695475:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425723520 00000100:00100000:3.0:1787367560.695491:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425723520 00000100:00100000:3.0:1787367560.695564:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:3.0:1787367560.695575:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:11430:x1874190425723520:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1787367560.695606:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367560.695631:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c37 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.695729:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f417e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.695744:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f417e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.695756:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f417e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367560.695767:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787367560.695891:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c37 expref: 41 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.695911:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f417e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c37 expref: 40 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.695938:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:3.0:1787367560.695941:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367560.695944:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f800, rc 0) 00000100:00100000:3.0:1787367560.696016:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11430:x1874190425723520:12345-192.168.204.23@tcp:101:cat.0 Request processed in 443us (1102us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787367560.696024:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:1.0:1787367560.706430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367560.706484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367560.706570:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425723904 00000100:00100000:0.0:1787367560.706580:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425723904 00000100:00100000:0.0:1787367560.706737:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1787367560.706752:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:2356:x1874190425723904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367560.706771:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367560.706814:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f417e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c37 expref: 40 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.706849:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367560.706856:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367560.706923:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+39:2356:x1874190425723904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 174us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367560.706931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1787367560.707448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425723776 00000100:00100000:3.0:1787367560.707455:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425723776 00000100:00100000:3.0:1787367560.707496:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1787367560.707505:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+39:11430:x1874190425723776:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1787367560.707836:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11430:x1874190425723776:12345-192.168.204.23@tcp:35:cat.0 Request processed in 331us (1419us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787367560.707843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1787367560.788467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367560.789166:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425724160 00000100:00100000:0.0:1787367560.789180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425724160 00000100:00100000:0.0:1787367560.789431:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:0.0:1787367560.789446:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11436:x1874190425724160:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:0.0:1787367560.789482:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367560.789486:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787367560.789522:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f40e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c0d expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789544:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367560.789549:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367560.789566:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f418c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c3e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789695:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789710:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789743:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789783:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.789797:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 40 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367560.789813:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbaefc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446698240:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367560.789926:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787367560.793670:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbaefc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446698240:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367560.793714:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367560.794479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367560.794682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425724288 00000100:00100000:0.0:1787367560.794696:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425724288 00010000:00010000:0.0:1787367560.794753:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 41 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367560.794799:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1787367560.794810:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92391050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+41:2357:x1874190425724288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367560.794829:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367560.794838:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 41 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794872:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 41 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794898:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c30 expref: 41 pid: 5843 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794917:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367560.794924:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794934:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794942:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.794980:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367560.795074:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367560.795077:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92391050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:2357:x1874190425724288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 266us (606us total) trans 0 rc 0/0 00010000:00010000:1.0:1787367560.795103:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367560.795104:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000004:00200000:1.0:1787367560.795140:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787367560.795423:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f418c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.795445:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367560.795471:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367560.795475:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367560.795478:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:1.0:1787367560.795530:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11436:x1874190425724160:12345-192.168.204.23@tcp:101:dd.0 Request processed in 6086us (7075us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787367560.795539:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:1.0:1787367560.797985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367560.798450:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425724544 00000100:00100000:3.0:1787367560.798465:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425724544 00000100:00100000:3.0:1787367560.798546:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 155 00000100:00100000:3.0:1787367560.798562:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11436:x1874190425724544:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:3.0:1787367560.798928:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.798950:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.798964:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367560.799546:0:6718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787367560.799581:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffb0ca75 reply state 000000007d0769bf transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367560.799593:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367560.799730:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:11436:x1874190425724544:12345-192.168.204.23@tcp:36:dd.0 Request processed in 1168us (1754us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787367560.799741:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 155 00000020:00080000:3.0:1787367560.799748:0:6718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367560.805801:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805827:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805835:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805867:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367560.805873:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805882:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805916:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367560.805920:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367560.805927:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367560.805934:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f41a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367560.837341:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367561.053728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367561.053894:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425724672 00000100:00100000:2.0:1787367561.053909:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425724672 00000100:00100000:2.0:1787367561.054015:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 156 00000100:00100000:2.0:1787367561.054029:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+42:11450:x1874190425724672:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:2.0:1787367561.054077:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367561.054112:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f41a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054287:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054308:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054322:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054341:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054347:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054353:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054495:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054516:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054563:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.054580:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 43 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367561.054599:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafdefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446698368:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367561.054741:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba6c0000 going to sleep for 11 seconds 00000100:00080000:0.0:1787367561.055496:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367561.061075:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafdefb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446698368:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367561.061117:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367561.064996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.065249:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425724928 00000100:00100000:0.0:1787367561.065265:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425724928 00000100:00100000:0.0:1787367561.065368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1787367561.065383:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+44:5596:x1874190425724928:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787367561.066244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:5596:x1874190425724928:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 857us (1257us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787367561.066255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:2.0:1787367561.073563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.075436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425725056 00000100:00100000:0.0:1787367561.075482:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425725056 00010000:00010000:0.0:1787367561.075557:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 45 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367561.075623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:0.0:1787367561.075634:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:2359:x1874190425725056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367561.075665:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367561.075673:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 45 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075690:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 45 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075721:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f4193 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c3e expref: 45 pid: 5841 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075743:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367561.075750:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075762:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075774:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.075830:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367561.075918:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+44:2359:x1874190425725056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 285us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.075937:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00010000:00010000:1.0:1787367561.076241:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076430:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367561.076496:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787367561.076502:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367561.076535:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076552:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076564:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076572:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076593:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076600:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367561.076605:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076613:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076625:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367561.076628:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367561.076633:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076639:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f41af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076667:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076674:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076680:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076685:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367561.076688:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076707:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076716:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f890a8b00) 00010000:00010000:1.0:1787367561.076719:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367561.076722:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076728:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f41b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076784:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f41a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c45 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076802:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c45 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.076811:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367561.076813:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367561.076815:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:1.0:1787367561.076863:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:11450:x1874190425724672:12345-192.168.204.23@tcp:101:stat.0 Request processed in 22838us (23157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367561.076872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 156 00000040:00080000:3.0:1787367561.091562:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367561.091576:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367561.091829:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787367561.091838:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367561.179922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.180161:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425725312 00000100:00100000:0.0:1787367561.180177:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425725312 00000100:00100000:1.0:1787367561.180655:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 157 00000100:00100000:1.0:1787367561.180672:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:11456:x1874190425725312:12345-192.168.204.23@tcp:36:truncate.0 00010000:00010000:1.0:1787367561.180917:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367561.180956:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f41bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c45 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.181277:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367561.181285:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367561.182245:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.182273:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.182289:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367561.182629:0:6718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787367561.182803:0:6718:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0bc74a8 reply state 0000000072f17704 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367561.182815:0:6718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367561.183060:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:11456:x1874190425725312:12345-192.168.204.23@tcp:36:truncate.0 Request processed in 2386us (3150us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787367561.183070:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 157 00000020:00080000:1.0:1787367561.183078:0:6718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787367561.188251:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188279:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188289:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188297:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367561.188304:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188314:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188339:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367561.188364:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367561.188372:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.188379:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367561.283804:0:7933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366559607827ns, next at 367559604140ns, rc = 0 00000100:00100000:2.0:1787367561.283920:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446698496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367561.284052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367561.284470:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446698880:0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.284515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367561.284550:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367561.284556:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446699008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.284582:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367561.284619:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446699008 00000100:00100000:0.0:1787367561.284627:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446699008 00000100:00100000:0.0:1787367561.284698:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787367561.284807:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446698624:0@lo:400:kworker.0 00000100:00100000:2.0:1787367561.284847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367561.284874:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446699136:0@lo:400:kworker.0 00000100:00100000:2.0:1787367561.284898:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367561.284919:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367561.284925:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446698752:0@lo:400:kworker.0 00000100:00100000:2.0:1787367561.284947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367561.284981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446698880 00000100:00100000:2.0:1787367561.284985:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446698880 00000100:00100000:2.0:1787367561.285016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446699136 00000100:00100000:2.0:1787367561.285019:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446699136 00000100:00100000:2.0:1787367561.285046:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446698752 00000100:00100000:2.0:1787367561.285049:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446698752 00000100:00100000:2.0:1787367561.285063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367561.285071:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446698880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367561.285137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446698880:12345-0@lo:400:kworker.0 Request processed in 66us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367561.285146:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787367561.285227:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446698880:0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.285410:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446699008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.285447:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446699008:12345-0@lo:400:kworker.0 Request processed in 43us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.285454:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787367561.285477:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367561.285482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367561.285518:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367561.285526:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446699136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.285561:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446699136:12345-0@lo:400:kworker.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.285567:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787367561.285580:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787367561.285586:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446698752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.285612:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446698752:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.285633:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787367561.285684:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446698752:0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.285696:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446699136:0@lo:400:kworker.0 00000100:00100000:3.0:1787367561.286468:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446698496 00000100:00100000:3.0:1787367561.286481:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446698496 00000100:00100000:3.0:1787367561.286539:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787367561.286548:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1f63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446698496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367561.286571:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367561.286639:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1f63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446698496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367561.286646:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787367561.287879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446698624 00000100:00100000:1.0:1787367561.287891:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446698624 00000100:00100000:1.0:1787367561.287947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787367561.287954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446698624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367561.288047:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446698624:12345-0@lo:400:kworker.0 Request processed in 93us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367561.288054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787367561.288150:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446698496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367561.288455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446699008:0@lo:400:kworker.0 00000100:00100000:0.0:1787367561.288776:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446698624:0@lo:400:kworker.0 00000100:00100000:3.0:1787367561.368286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.371514:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425725440 00000100:00100000:0.0:1787367561.371538:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425725440 00000100:00100000:0.0:1787367561.371883:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:0.0:1787367561.371897:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+44:11470:x1874190425725440:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:0.0:1787367561.371931:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367561.371960:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f41cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c4c expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372078:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372099:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372112:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372130:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372137:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372144:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372324:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372334:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372341:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367561.372391:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787367561.372396:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367561.372421:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372435:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372445:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372451:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372459:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372466:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367561.372471:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372480:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372503:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367561.372506:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367561.372513:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372520:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f41d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372537:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372543:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372549:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372554:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367561.372569:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372576:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372585:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f83c18d00) 00010000:00010000:0.0:1787367561.372588:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367561.372591:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372596:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f41d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372646:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f41cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 46 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372663:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 45 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.372672:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367561.372674:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367561.372677:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599e00, rc 0) 00000100:00100000:0.0:1787367561.372782:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:11470:x1874190425725440:12345-192.168.204.23@tcp:101:stat.0 Request processed in 887us (4910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.372792:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:3.0:1787367561.485178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.494240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425725696 00000100:00100000:0.0:1787367561.494262:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425725696 00000100:00100000:0.0:1787367561.494476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 159 00000100:00100000:0.0:1787367561.494490:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+45:11480:x1874190425725696:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367561.494718:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367561.494748:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f41e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c53 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367561.494918:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787367561.495102:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f41e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c53 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.495120:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367561.495123:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367561.495148:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f41e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c53 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.495165:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367561.495315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+46:11480:x1874190425725696:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 826us (10314us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787367561.495325:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 159 00000100:00100000:2.0:1787367561.509786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.510072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425725952 00000100:00100000:3.0:1787367561.510103:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425725952 00000100:00100000:3.0:1787367561.510179:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:3.0:1787367561.510212:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+46:11480:x1874190425725952:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367561.510617:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:11480:x1874190425725952:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 427us (847us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787367561.510627:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:2.0:1787367561.595102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367561.595827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425726208 00000100:00100000:1.0:1787367561.595843:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425726208 00000100:00100000:1.0:1787367561.595926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 160 00000100:00100000:1.0:1787367561.595937:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:11486:x1874190425726208:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1787367561.595970:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367561.595999:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f41f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c5a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.596162:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.596185:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 48 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.596237:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.596298:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 48 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.596316:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 48 pid: 6718 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367561.596332:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446699264:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367561.596489:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367561.600330:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446699264:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367561.600379:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367561.605644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.607425:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425726336 00000100:00100000:3.0:1787367561.607447:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425726336 00010000:00010000:3.0:1787367561.607639:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 49 pid: 6718 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367561.607700:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367561.607713:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+49:2357:x1874190425726336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367561.607734:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367561.607742:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 49 pid: 6718 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607761:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 49 pid: 6718 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607790:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f41e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c4c expref: 49 pid: 6718 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607814:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:3.0:1787367561.607821:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607854:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607863:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.607911:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367561.607991:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+48:2357:x1874190425726336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 281us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367561.608000:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00010000:00010000:1.0:1787367561.608327:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.608337:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367561.608366:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787367561.608692:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f41f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.608712:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.608720:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367561.608723:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367561.608726:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f200, rc 0) 00000100:00100000:1.0:1787367561.613729:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+48:11486:x1874190425726208:12345-192.168.204.23@tcp:101:bash.0 Request processed in 17772us (18623us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787367561.613747:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 160 00000100:00100000:2.0:1787367561.619045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.619296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425726592 00000100:00100000:0.0:1787367561.619463:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425726592 00000100:00100000:0.0:1787367561.619658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 161 00000100:00100000:0.0:1787367561.619671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+48:11486:x1874190425726592:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:0.0:1787367561.620056:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.620078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.620091:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367561.620169:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787367561.620220:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000edf5cb5 reply state 00000000e990e70f transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367561.620231:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367561.620401:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11486:x1874190425726592:12345-192.168.204.23@tcp:36:bash.0 Request processed in 728us (1378us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787367561.620410:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 161 00000020:00080000:0.0:1787367561.620416:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787367561.624295:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624319:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624328:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624335:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367561.624340:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624350:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624372:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367561.624375:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367561.624380:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.624387:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f420a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367561.627449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.627782:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425726720 00000100:00100000:0.0:1787367561.627797:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425726720 00000100:00100000:0.0:1787367561.627884:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:0.0:1787367561.629497:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:11486:x1874190425726720:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367561.629544:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367561.629575:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f4211 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c61 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.629694:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.629712:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.629722:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.629769:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.629787:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 51 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367561.629802:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbaeffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446699392:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367561.630054:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367561.633376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367561.633576:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbaeffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446699392:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367561.633613:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367561.633680:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425726848 00000100:00100000:3.0:1787367561.633690:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425726848 00010000:00010000:3.0:1787367561.633742:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 52 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367561.633852:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:3.0:1787367561.633864:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:2356:x1874190425726848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367561.633886:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367561.633906:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 52 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.633920:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 52 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.633947:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f41fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c5a expref: 52 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.633989:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:3.0:1787367561.633995:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.634006:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.634033:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.634065:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367561.634144:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:2356:x1874190425726848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 281us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367561.634153:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00010000:00010000:1.0:1787367561.634321:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.634330:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367561.634390:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787367561.634395:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367561.634420:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.634468:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f4211 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c61 expref: 52 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.634485:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c61 expref: 51 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.634494:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367561.634497:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367561.634500:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598a00, rc 0) 00000100:00100000:1.0:1787367561.634529:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11486:x1874190425726720:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5064us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367561.634536:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:2.0:1787367561.637491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.637617:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425727104 00000100:00100000:3.0:1787367561.637631:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425727104 00000100:00100000:3.0:1787367561.637706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1787367561.637717:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:11486:x1874190425727104:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:3.0:1787367561.638328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11486:x1874190425727104:12345-192.168.204.23@tcp:35:bash.0 Request processed in 611us (851us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787367561.638334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:0.0:1787367561.681349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.681427:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425727360 00000100:00100000:3.0:1787367561.681440:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425727360 00000100:00100000:3.0:1787367561.681526:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00100000:3.0:1787367561.681537:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11496:x1874190425727360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367561.681574:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367561.681630:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f421f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c68 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367561.681807:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787367561.682000:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f421f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c68 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.682036:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:3.0:1787367561.682040:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367561.682048:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f421f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c68 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.682070:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367561.682398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaeffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11496:x1874190425727360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 860us (1065us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787367561.682408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00100000:0.0:1787367561.686509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367561.686601:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425727488 00000100:00100000:1.0:1787367561.686615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425727488 00000100:00100000:1.0:1787367561.686701:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 164 00000100:00100000:1.0:1787367561.686714:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11496:x1874190425727488:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:1.0:1787367561.686825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.686849:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.686862:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.686880:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.686913:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.686920:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687120:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687130:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687139:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367561.687236:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687260:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687268:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687276:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367561.687281:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687290:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687314:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367561.687317:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367561.687324:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687332:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f422d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687350:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687358:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687365:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687371:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367561.687374:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687382:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687391:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97b00) 00010000:00010000:1.0:1787367561.687394:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367561.687397:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687431:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687439:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687446:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687451:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367561.687454:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687460:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687469:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:1.0:1787367561.687471:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367561.687475:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.687481:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f423b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367561.687599:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11496:x1874190425727488:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 884us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367561.687608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 164 00000100:00100000:2.0:1787367561.689076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.689299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425727744 00000100:00100000:0.0:1787367561.689310:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425727744 00000100:00100000:0.0:1787367561.689414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1787367561.689427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11496:x1874190425727744:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367561.689756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+53:11496:x1874190425727744:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 331us (692us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787367561.689765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1787367561.720650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367561.720802:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728000 00000100:00100000:2.0:1787367561.720816:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728000 00000100:00100000:2.0:1787367561.720900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:2.0:1787367561.720913:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+53:11499:x1874190425728000:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367561.720951:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367561.720980:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4242 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c6f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721106:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721125:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721140:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721159:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721167:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721175:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721390:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721401:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721433:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367561.721445:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787367561.721574:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721582:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721596:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367561.721602:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721610:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721625:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367561.721628:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367561.721633:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721640:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721655:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721661:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721674:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721680:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367561.721683:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721691:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721700:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367561.721703:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367561.721706:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721712:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f4250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721762:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4242 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c6f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721779:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c6f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.721787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:2.0:1787367561.721790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367561.721793:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367561.721886:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11499:x1874190425728000:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 976us (1253us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787367561.721905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:1.0:1787367561.726119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367561.726331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.726828:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728256 00000100:00100000:3.0:1787367561.726845:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728256 00000100:00100000:3.0:1787367561.726947:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1787367561.726959:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:2358:x1874190425728256:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367561.726982:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367561.727029:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f4257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c6f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367561.727055:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:3.0:1787367561.727061:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367561.727130:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:2358:x1874190425728256:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 173us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367561.727175:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1787367561.728121:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728128 00000100:00100000:0.0:1787367561.728133:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728128 00000100:00100000:0.0:1787367561.728489:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:0.0:1787367561.728500:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11499:x1874190425728128:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1787367561.728593:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728613:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728626:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728663:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728671:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728694:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728700:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367561.728705:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728713:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728727:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367561.728730:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367561.728735:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.728742:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f4265 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367561.728838:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11499:x1874190425728128:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 339us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.728845:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:2.0:1787367561.731775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367561.731864:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728512 00000100:00100000:3.0:1787367561.731878:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728512 00000100:00100000:3.0:1787367561.731961:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:3.0:1787367561.731974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11499:x1874190425728512:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367561.732585:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11499:x1874190425728512:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 611us (820us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787367561.732595:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:2.0:1787367561.846688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.851235:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728768 00000100:00100000:0.0:1787367561.851260:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728768 00000100:00100000:0.0:1787367561.851371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1787367561.851382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11517:x1874190425728768:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1787367561.851417:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367561.851446:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f426c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c76 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.851600:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4273 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.851618:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.851631:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367561.851643:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787367561.851803:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598c00/0xcbf1f1bac53f426c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c76 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.851825:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c76 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.851834:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367561.851837:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787367561.851841:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599000, rc 0) 00000100:00100000:0.0:1787367561.851934:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11517:x1874190425728768:12345-192.168.204.23@tcp:101:cat.0 Request processed in 554us (5261us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787367561.851941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00010000:00010000:0.0:1787367561.859602:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367561.904312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367561.904526:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425728896 00000100:00100000:1.0:1787367561.904564:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425728896 00000100:00100000:1.0:1787367561.904642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:1.0:1787367561.904653:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11518:x1874190425728896:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367561.904686:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367561.904717:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c7d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.904822:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.904841:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.904856:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367561.904951:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787367561.904955:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367561.904983:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.905027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c7d expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.905051:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c7d expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367561.905060:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367561.905064:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367561.905069:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00100000:1.0:1787367561.905160:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11518:x1874190425728896:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 508us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367561.905168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:2.0:1787367561.913711:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.914684:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729280 00000100:00100000:0.0:1787367561.914714:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729280 00000100:00100000:0.0:1787367561.914825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1787367561.914839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11518:x1874190425729280:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367561.919723:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11518:x1874190425729280:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 4125us (5268us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787367561.919741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:2.0:1787367561.932606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.933088:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729408 00000100:00100000:0.0:1787367561.933099:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729408 00000100:00100000:0.0:1787367561.934773:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1787367561.934794:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11518:x1874190425729408:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:0.0:1787367561.934815:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787367561.934845:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f4218 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c61 expref: 59 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.934870:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c76 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.934882:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c22 expref: 57 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367561.934895:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f91b61300) 00010000:00010000:0.0:1787367561.934908:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367561.934979:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:11518:x1874190425729408:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 195us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367561.934988:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1787367561.963061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367561.971652:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729536 00000100:00100000:0.0:1787367561.971671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729536 00000100:00100000:2.0:1787367561.975822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:2.0:1787367561.975836:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:11518:x1874190425729536:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:2.0:1787367561.975984:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.976003:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367561.976015:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367561.976451:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787367561.976568:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:11518:x1874190425729536:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 733us (13518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367561.976577:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:2.0:1787367562.057720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.057834:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729664 00000100:00100000:1.0:1787367562.057844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729664 00000100:00100000:1.0:1787367562.057903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:1.0:1787367562.057913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:11520:x1874190425729664:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367562.057934:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367562.057955:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4296 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c84 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058047:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058063:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058075:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058090:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058097:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058104:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058265:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058299:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367562.058334:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787367562.058339:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367562.058356:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058369:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058377:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058384:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058391:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058398:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367562.058402:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058410:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367562.058425:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367562.058435:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f429d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058456:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058461:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058466:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058472:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367562.058475:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058480:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058487:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97b00) 00010000:00010000:1.0:1787367562.058489:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367562.058492:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058498:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f42a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058526:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4296 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058551:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.058559:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:1.0:1787367562.058561:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367562.058564:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f800, rc 0) 00000100:00100000:1.0:1787367562.058618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11520:x1874190425729664:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 706us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.058625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 170 00000040:00080000:3.0:1787367562.115738:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367562.115749:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367562.115806:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787367562.115828:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367562.117535:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446699520:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367562.117741:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f9a697c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367562.153605:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446699520:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787367562.153939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.154113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729792 00000100:00100000:3.0:1787367562.154120:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729792 00000100:00100000:3.0:1787367562.154224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:3.0:1787367562.154235:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11526:x1874190425729792:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787367562.154276:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787367562.154393:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11526:x1874190425729792:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 159us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367562.154402:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:2.0:1787367562.164734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.164856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425729920 00000100:00100000:1.0:1787367562.164868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425729920 00000100:00100000:1.0:1787367562.164935:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:1.0:1787367562.164948:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11526:x1874190425729920:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787367562.165052:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.165072:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.165083:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166725:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166799:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166850:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166859:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166867:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367562.166930:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787367562.166935:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367562.166952:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166966:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166974:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166983:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.166989:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.166994:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167009:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167037:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:2.0:1787367562.167041:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367562.167047:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167053:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f42b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167074:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167080:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167087:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167092:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.167095:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167102:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167109:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367562.167113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367562.167115:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167133:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167153:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167159:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167164:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167169:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.167172:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167177:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167185:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367562.167187:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367562.167189:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.167247:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.167587:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11526:x1874190425729920:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 2634us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367562.167600:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:1.0:1787367562.174306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.174500:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425730176 00000100:00100000:3.0:1787367562.174539:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425730176 00000100:00100000:3.0:1787367562.174616:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:3.0:1787367562.174629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11526:x1874190425730176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.174659:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367562.174689:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f42c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.174835:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.174854:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.174868:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367562.174881:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787367562.175031:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175041:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175051:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175058:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367562.175064:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175073:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175097:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:3.0:1787367562.175101:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367562.175107:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175114:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f42ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175170:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f42c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c8b expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175181:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:3.0:1787367562.175184:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367562.175188:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f42c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c8b expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.175249:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367562.175336:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 709us (1048us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787367562.175345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:0.0:1787367562.189654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.189861:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425730304 00000100:00100000:1.0:1787367562.189875:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425730304 00000100:00100000:1.0:1787367562.189954:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:1.0:1787367562.189965:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730304:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787367562.190045:0:6718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787367562.190224:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730304:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 260us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.190232:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:1.0:1787367562.197491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367562.207613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425730560 00000100:00100000:2.0:1787367562.207635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425730560 00000100:00100000:2.0:1787367562.207740:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 175 00000100:00100000:2.0:1787367562.207753:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367562.207782:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367562.207786:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787367562.208263:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4288 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c7d expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.208295:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367562.208301:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367562.208320:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c92 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367562.211330:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787367562.211676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.211700:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.211715:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.211811:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f42dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c92 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.211836:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c92 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.211872:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367562.211876:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367562.211881:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74600, rc 0) 00000100:00100000:2.0:1787367562.212027:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11526:x1874190425730560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 4275us (14550us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787367562.212038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 175 00000100:00100000:3.0:1787367562.225953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.226080:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425730816 00000100:00100000:1.0:1787367562.226094:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425730816 00000100:00100000:1.0:1787367562.226175:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:1.0:1787367562.226187:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11526:x1874190425730816:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367562.226318:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367562.226355:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f42e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c92 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226527:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f829e0100) 00010000:00010000:1.0:1787367562.226545:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367562.226580:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226598:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226611:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226629:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226638:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226662:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226768:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226777:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226784:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226790:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367562.226795:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.226804:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227033:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367562.227036:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367562.227041:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227048:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f42f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227058:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227063:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227076:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227082:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367562.227085:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227091:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227099:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4ececed8 (ffff9e8f86d97b00) 00010000:00010000:1.0:1787367562.227102:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367562.227105:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.227110:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f42f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4ececed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.227480:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730816:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1291us (1544us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367562.227490:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:1.0:1787367562.240064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.241605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425730944 00000100:00100000:3.0:1787367562.241629:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425730944 00000100:00100000:3.0:1787367562.241733:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 177 00000100:00100000:3.0:1787367562.241749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11526:x1874190425730944:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.241780:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367562.241817:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f42ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5c99 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.241881:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.241898:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.241912:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.242066:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f42ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.242091:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.242101:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:3.0:1787367562.242104:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367562.242107:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e200, rc 0) 00000100:00100000:3.0:1787367562.242259:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11526:x1874190425730944:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 514us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367562.242269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 177 00000100:00100000:0.0:1787367562.259094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.259259:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425731200 00000100:00100000:3.0:1787367562.259273:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425731200 00000100:00100000:3.0:1787367562.259355:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:3.0:1787367562.259367:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11526:x1874190425731200:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.259537:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.259570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.259585:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787367562.259961:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787367562.259975:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367535781582ns, next at 368535777897ns, rc = 0 00000004:00010000:3.0:1787367562.260107:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fec41157 reply state 0000000025600507 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367562.260119:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367562.260313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11526:x1874190425731200:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 946us (1242us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787367562.260321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 178 00010000:00010000:2.0:1787367562.263944:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.263968:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.263977:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.263984:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.263990:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.263998:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.264033:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:2.0:1787367562.264037:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367562.264043:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.264049:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f430d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367562.270714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367562.276664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425731328 00000100:00100000:2.0:1787367562.276688:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425731328 00000100:00100000:3.0:1787367562.276864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 179 00000100:00100000:3.0:1787367562.276878:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11526:x1874190425731328:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.276913:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367562.276942:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ca0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.277037:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.277055:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.278552:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:3.0:1787367562.278558:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367562.278563:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e400, rc 0) 00000100:00100000:3.0:1787367562.278740:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11526:x1874190425731328:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1859us (8035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367562.278751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 179 00000100:00100000:3.0:1787367562.297638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367562.303646:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425731456 00000100:00100000:2.0:1787367562.303671:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425731456 00000100:00100000:3.0:1787367562.319059:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:3.0:1787367562.319089:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2357:x1874190425731456:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787367562.319696:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367562.328873:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425731456:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 9767us (31233us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787367562.328896:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1787367562.344844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.348176:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425731712 00000100:00100000:3.0:1787367562.362672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425731712 00000100:00100000:2.0:1787367562.363638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1787367562.363653:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11526:x1874190425731712:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787367562.368874:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11526:x1874190425731712:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 3013us (21835us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787367562.368912:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1787367562.372626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.372880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425731968 00000100:00100000:3.0:1787367562.372894:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425731968 00000100:00100000:3.0:1787367562.372975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:3.0:1787367562.372986:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11526:x1874190425731968:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367562.374956:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11526:x1874190425731968:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 1954us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367562.374974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:1.0:1787367562.381352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.381671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732096 00000100:00100000:3.0:1787367562.381751:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732096 00000100:00100000:3.0:1787367562.381838:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:3.0:1787367562.381851:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11526:x1874190425732096:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.381879:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367562.381913:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f431b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ca7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.383263:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.383296:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.383312:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367562.383367:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367562.383404:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.385965:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f431b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca7 expref: 64 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.386018:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca7 expref: 63 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.386031:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:3.0:1787367562.386034:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787367562.386040:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367562.386149:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+63:11526:x1874190425732096:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 4299us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367562.386161:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:0.0:1787367562.391085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.391599:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732224 00000100:00100000:1.0:1787367562.391617:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732224 00000100:00100000:1.0:1787367562.391816:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:1.0:1787367562.391831:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425732224:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367562.391866:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367562.391921:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cae expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367562.391965:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89108a, blocks: 0x1 00010000:00010000:1.0:1787367562.391996:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1787367562.392002:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367562.392218:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.392251:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.392277:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fa00, rc 0) 00000100:00100000:1.0:1787367562.392367:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425732224:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 539us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.392376:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:0.0:1787367562.400932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.401057:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732480 00000100:00100000:1.0:1787367562.401158:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732480 00000100:00100000:0.0:1787367562.401886:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 182 00000100:00100000:0.0:1787367562.401904:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+63:11526:x1874190425732480:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787367562.402139:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+63:11526:x1874190425732480:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 241us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367562.402225:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 182 00000100:00100000:0.0:1787367562.412904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.413080:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732608 00000100:00100000:3.0:1787367562.413103:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732608 00000100:00100000:3.0:1787367562.413186:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:3.0:1787367562.413403:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:11526:x1874190425732608:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.413436:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367562.413462:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cb5 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.413507:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.413519:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367562.413524:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367562.413531:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.413577:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.413594:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367562.413611:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446699648:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367562.414049:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87dcb480 going to sleep for 11 seconds 00000100:00100000:3.0:1787367562.422239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367562.422738:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446699648:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367562.422786:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.422816:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f000, rc 0) 00000100:00100000:0.0:1787367562.422915:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:11526:x1874190425732608:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 9527us (10026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367562.422926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:1.0:1787367562.424972:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732736 00000100:00100000:1.0:1787367562.425068:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732736 00010000:00010000:1.0:1787367562.425131:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.425183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:1.0:1787367562.425218:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2357:x1874190425732736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367562.425239:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367562.425272:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.425303:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.425336:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4329 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cae expref: 9 pid: 6695 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.425916:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367562.425924:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367562.425937:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.425952:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.426128:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.426152:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446699776:192.168.204.23@tcp:105: 00000100:00100000:1.0:1787367562.426302:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367562.429148:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446699776:192.168.204.23@tcp:105: 00010000:00010000:1.0:1787367562.429188:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367562.429286:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425732736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4092us (7102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.429299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:0.0:1787367562.434144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.435759:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732864 00000100:00100000:1.0:1787367562.435782:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732864 00002000:00100000:1.0:1787367562.435858:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e8fbb1c8e00 x1874190425732864/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:203/0 lens 504/0 e 0 to 0 dl 1787367573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367562.435941:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbb1c8e00 with x1874190425732864 ext(0->8) 00002000:00010000:1.0:1787367562.435948:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbb1c8e00 00000100:00100000:1.0:1787367562.435991:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1787367562.436003:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425732864:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787367562.437797:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2356:x1874190425732864:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 1779us (3653us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787367562.437815:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00002000:00100000:1.0:1787367562.437827:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9e8fbb1c8e00 x1874190425732864/t4294967314(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:203/0 lens 504/448 e 0 to 0 dl 1787367573 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367562.437838:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbb1c8e00 with x1874190425732864 ext(0->8) 00002000:00010000:1.0:1787367562.437846:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbb1c8e00 00000100:00100000:3.0:1787367562.441582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.441697:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425732992 00000100:00100000:1.0:1787367562.441713:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425732992 00000100:00100000:1.0:1787367562.441792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 183 00000100:00100000:1.0:1787367562.441806:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+63:11526:x1874190425732992:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787367562.500552:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:0.0:1787367562.500610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000001:00080000:2.0:1787367562.500628:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787367562.500653:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1787367562.500656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000004:00080000:2.0:1787367562.500703:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1787367562.500708:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733248 00000100:00100000:3.0:1787367562.500722:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733248 00000004:00080000:2.0:1787367562.500729:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787367562.500740:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f87dcb540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787367562.500745:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbf406c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f87dcb900 00000020:00080000:2.0:1787367562.500749:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbf406200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f857fac00 00000100:00100000:3.0:1787367562.500801:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1787367562.500833:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425733248:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367562.500949:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425733248:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367562.500957:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:1.0:1787367562.500997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11526:x1874190425732992:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 59193us (59430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.501021:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 183 00000100:00100000:3.0:1787367562.501233:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446699904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787367562.501284:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367562.502175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367562.502340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733120 00000100:00100000:0.0:1787367562.502348:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733120 00000100:00080000:2.0:1787367562.502586:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367562.502662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 294 00000100:00100000:0.0:1787367562.502674:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425733120:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367562.502777:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425733120:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 106us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367562.502786:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 294 00000020:00080000:0.0:1787367562.502821:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1787367562.503701:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367562.503728:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446700032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787367562.503814:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733376 00000100:00100000:2.0:1787367562.503819:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733376 00000100:00100000:2.0:1787367562.504575:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:2.0:1787367562.504589:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425733376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367562.504676:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425733376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367562.504684:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00080000:2.0:1787367562.504713:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367562.504729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787367562.504846:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787367562.504917:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446699904 00000100:00100000:1.0:1787367562.504926:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446699904 00000100:00080000:3.0:1787367562.506791:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367562.506897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.507423:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446700032 00000100:00100000:1.0:1787367562.507454:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446700032 00000100:00100000:1.0:1787367562.507501:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733504 00000100:00100000:1.0:1787367562.507505:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733504 00000100:00100000:1.0:1787367562.507528:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367562.507540:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446699904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787367562.507581:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00002000:00080000:1.0:1787367562.507584:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:0.0:1787367562.507591:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446700032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787367562.507631:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a891088, atime: 0x6a891088, ctime: 0x6a891088, blocks: 0x1 00010000:00010000:1.0:1787367562.507640:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.507662:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1787367562.507667:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367562.507676:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.507711:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.507724:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.507732:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.507758:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787367562.507810:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787367562.507813:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787367562 00002000:00010000:0.0:1787367562.507816:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787367562.507818:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787367562 -> 1787367562 00002000:00010000:0.0:1787367562.507820:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1787367562.507966:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367562.507976:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.507985:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367562.507990:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.508000:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.508035:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.508044:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032853e51/0xcbf1f1bac53f4337 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.508080:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367562.508084:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367562.508086:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367562.508308:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446700032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 717us (3576us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787367562.508318:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787367562.508344:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:0.0:1787367562.508353:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2356:x1874190425733504:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787367562.508891:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874190446699904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1351us (7603us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787367562.508899:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:1.0:1787367562.508970:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb38c6a00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787367562.508980:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446699904:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787367562.509793:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fa014c380/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787367562.509802:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446700032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787367562.576022:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2356:x1874190425733504:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 67635us (69098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367562.576043:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000001:00080000:0.0:1787367562.576112:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1787367562.576128:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1787367562.584644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367562.584747:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733760 00000100:00100000:3.0:1787367562.584763:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733760 00000100:00100000:3.0:1787367562.584883:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 184 00000100:00100000:3.0:1787367562.584897:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11526:x1874190425733760:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787367562.584990:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367562.585044:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.585070:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:3.0:1787367562.585077:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367562.585125:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.585154:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.585167:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367562.585560:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000393002d reply state 000000005b9d57c9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367562.585592:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367562.585750:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9080c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11526:x1874190425733760:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 854us (1119us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787367562.585761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 184 00000100:00100000:0.0:1787367562.595683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.595763:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425733888 00000100:00100000:1.0:1787367562.595779:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425733888 00000100:00100000:1.0:1787367562.595858:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:1.0:1787367562.595871:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425733888:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787367562.596403:0:8211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787367562.596408:0:8211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787367562 -> 1787367561 00002000:00010000:1.0:1787367562.596411:0:8211:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787367560 00002000:00010000:1.0:1787367562.596414:0:8211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787367562 -> 1787367561 00002000:00010000:1.0:1787367562.596416:0:8211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787367562.596528:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425733888:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 657us (855us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787367562.596538:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00010000:00010000:2.0:1787367562.597534:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597550:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597561:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597569:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.597575:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597586:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597611:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:2.0:1787367562.597614:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367562.597623:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.597631:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f433e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.602131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367562.602532:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734144 00000100:00100000:0.0:1787367562.602558:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734144 00000100:00100000:0.0:1787367562.602648:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 185 00000100:00100000:0.0:1787367562.602661:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11526:x1874190425734144:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787367562.602778:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.602807:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.602819:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.602872:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.602897:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 18 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367562.602915:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446700160:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367562.603061:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367562.616138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.616219:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734272 00000100:00100000:2.0:1787367562.616391:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446700160:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367562.616430:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.616839:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734272 00010000:00010000:1.0:1787367562.616902:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 19 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.616959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:1.0:1787367562.616971:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92390850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:2357:x1874190425734272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367562.616990:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367562.616998:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 19 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.617046:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 19 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.617075:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c99 expref: 19 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.617098:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:1.0:1787367562.617103:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.617114:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.617123:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.618137:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367562.618375:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618388:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618437:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618446:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618459:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618466:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367562.618470:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618480:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618496:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:0.0:1787367562.618500:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787367562.618505:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.618511:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4345 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367562.618563:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11526:x1874190425734144:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 15905us (16453us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787367562.618574:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 185 00000100:00100000:1.0:1787367562.618630:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92390850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2357:x1874190425734272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1276us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.618640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1787367562.621083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.621348:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734400 00000100:00100000:1.0:1787367562.621361:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734400 00000100:00100000:1.0:1787367562.621464:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1787367562.621476:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2359:x1874190425734400:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787367562.621538:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.621583:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.621595:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367562.621601:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367562.621606:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.621653:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.621671:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 8 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.621701:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874190446700288:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367562.621812:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277480 going to sleep for 11 seconds 00000100:00100000:3.0:1787367562.627914:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1874190446700288:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367562.627959:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.629281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367562.629377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734528 00000100:00100000:0.0:1787367562.629388:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734528 00010000:00010000:0.0:1787367562.629443:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367562.629488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1787367562.629499:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425734528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367562.629532:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367562.629562:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.629577:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.629606:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f4330 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cb5 expref: 9 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.629626:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367562.629631:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367562.629637:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.629649:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.629700:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367562.629764:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425734528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 266us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367562.629772:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00010000:00010000:2.0:1787367562.629902:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629912:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629943:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629953:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629960:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629968:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367562.629973:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.629983:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.630028:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.630037:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032853e51/0xcbf1f1bac53f434c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.630092:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425734400:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 8619us (9024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367562.630101:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:2.0:1787367562.632099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367562.632186:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734784 00000100:00100000:0.0:1787367562.632224:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734784 00000100:00100000:0.0:1787367562.632360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 186 00000100:00100000:0.0:1787367562.632372:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+17:11526:x1874190425734784:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787367562.632493:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.632516:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.632529:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.633501:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.633523:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.633534:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.633582:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367562.633600:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 18 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367562.633617:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446700416:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367562.633914:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367562.636711:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446700416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367562.636761:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.638570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.638801:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425734912 00000100:00100000:1.0:1787367562.638814:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425734912 00010000:00010000:1.0:1787367562.638871:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.638921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:1.0:1787367562.638945:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:2357:x1874190425734912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367562.638967:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367562.638976:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.638992:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.639036:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ca0 expref: 19 pid: 5843 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.639057:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:1.0:1787367562.639063:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.639076:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.639085:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.639172:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367562.639743:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2357:x1874190425734912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 798us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.639754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00010000:00010000:2.0:1787367562.640326:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.640339:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367562.640598:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787367562.640780:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787367562.640835:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787367562.641810:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446700544:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787367562.641899:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367562.641950:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787367562.642021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446700544 00000100:00100000:1.0:1787367562.642031:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446700544 00000100:00100000:1.0:1787367562.642132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367562.642157:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874190446700544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367562.642322:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874190446700544:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.642330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367562.642420:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787367562.642428:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fa014c380, transno 4294967315 00000100:00100000:3.0:1787367562.642449:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446700544:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787367562.643840:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787367562.643946:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446700672:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787367562.644030:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367562.644097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446700672 00000100:00100000:2.0:1787367562.644106:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446700672 00000100:00100000:1.0:1787367562.644400:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787367562.644413:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874190446700672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367562.644659:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1874190446700672:12345-0@lo:1000:mdt00_002.0 Request processed in 248us (629us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787367562.644667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367562.644825:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367562.644864:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446700672:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787367562.644912:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644923:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644931:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644938:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.644943:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644952:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644971:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f91b61200) 00010000:00010000:2.0:1787367562.644975:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367562.644981:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.644989:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f435a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645038:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645045:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645058:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645063:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367562.645066:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645072:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645081:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:2.0:1787367562.645084:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367562.645087:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645093:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f428f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645124:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645141:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645344:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645379:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367562.645407:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 21 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367562.645421:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446700800:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367562.645541:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367562.647792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.648175:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425735040 00000100:00100000:1.0:1787367562.648187:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425735040 00010000:00010000:1.0:1787367562.648367:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 22 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.648412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:1.0:1787367562.648425:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:2356:x1874190425735040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367562.648445:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367562.648453:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 22 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.648468:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 22 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.648496:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:1.0:1787367562.648502:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.648515:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.648531:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.648560:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367562.648627:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:2356:x1874190425735040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 204us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367562.648635:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00010000:00010000:3.0:1787367562.650045:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f42ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5c84 expref: 21 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367562.650069:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446700800:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367562.650098:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650110:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650119:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650137:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650160:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650168:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650175:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367562.650180:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650208:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650226:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:3.0:1787367562.650229:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367562.650234:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650243:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4361 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650253:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650260:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650265:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650270:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367562.650278:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650285:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650294:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f890a8b00) 00010000:00010000:3.0:1787367562.650296:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367562.650299:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.650305:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f4353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367562.650784:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11526:x1874190425734784:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 18410us (18689us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787367562.650796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 186 00000020:00080000:1.0:1787367562.650804:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787367562.651171:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367562.651177:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367562.652817:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787367562.652840:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367562.655429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367562.655642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425735296 00000100:00100000:1.0:1787367562.655653:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425735296 00000100:00100000:1.0:1787367562.655788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:1.0:1787367562.655801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11526:x1874190425735296:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787367562.656879:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787367562.656999:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787367562.657075:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657112:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657121:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657144:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367562.657173:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367562.657318:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367562.657328:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.657336:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367562.657341:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.657350:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.657367:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9e8f86d97800) 00010000:00010000:3.0:1787367562.657371:0:7632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787367562.657377:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.657390:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4368 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367562.657411:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367562.657413:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367562.657414:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367562.659845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:11526:x1874190425735296:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 4030us (4414us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787367562.659862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000020:00080000:1.0:1787367562.659871:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787367562.884674:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787367563.199931:0:12458:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787367563.199947:0:12458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367563.200037:0:12458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787367563.200050:0:12458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367563.332010:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb38c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446700928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367563.332131:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367563.337412:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446700928 00000100:00100000:3.0:1787367563.337435:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446700928 00000100:00100000:3.0:1787367563.337530:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367563.337544:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446700928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367563.337590:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787367563.337711:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446700928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (5580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367563.337719:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787367563.337759:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367563.337886:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb38c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446700928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367563.368962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.369110:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425735552 00000100:00100000:3.0:1787367563.369125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425735552 00000100:00100000:3.0:1787367563.369318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 187 00000100:00100000:3.0:1787367563.369332:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:11541:x1874190425735552:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367563.369364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367563.369389:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f436f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cbc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.369867:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4376 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.369888:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.369917:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367563.369933:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787367563.370153:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f436f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cbc expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.370177:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cbc expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.370188:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00000100:00080000:0.0:1787367563.372019:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787367563.374401:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787367563.374416:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f200, rc 0) 00000100:00100000:3.0:1787367563.376794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11541:x1874190425735552:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 7445us (7826us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787367563.376812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 187 00000100:00100000:3.0:1787367563.381053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367563.382207:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425735680 00000100:00100000:1.0:1787367563.382290:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425735680 00000100:00100000:1.0:1787367563.382644:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:1.0:1787367563.382658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11541:x1874190425735680:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:1.0:1787367563.382775:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.382799:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.382830:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.382967:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.382976:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.382984:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.383629:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.383642:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.383650:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367563.383707:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.383723:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384278:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384287:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384308:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.384313:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384322:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384339:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367563.384342:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367563.384348:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384354:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384369:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384375:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384381:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384386:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.384388:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384394:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384413:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97600) 00010000:00010000:1.0:1787367563.384416:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367563.384419:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384425:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f438b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384442:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384448:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384454:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384460:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.384463:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384469:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384477:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97400) 00010000:00010000:1.0:1787367563.384479:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367563.384482:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.384487:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367563.385010:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11541:x1874190425735680:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 2346us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367563.385024:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:0.0:1787367563.448149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367563.449006:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425735936 00000100:00100000:2.0:1787367563.449023:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425735936 00000100:00100000:2.0:1787367563.449108:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:2.0:1787367563.449124:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11544:x1874190425735936:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367563.449154:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367563.449183:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4399 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cc3 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449318:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449339:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449355:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449378:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449400:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.449409:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451473:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451501:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451514:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367563.451532:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787367563.451688:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451697:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451705:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.451712:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.451717:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.452805:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.452938:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367563.452943:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367563.452951:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.452959:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f43a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.452977:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.452984:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453004:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453009:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.453012:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453026:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453034:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367563.453036:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367563.453039:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453044:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f43a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453126:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4399 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 27 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453141:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 26 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.453148:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367563.453150:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367563.453152:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75e00, rc 0) 00000100:00100000:2.0:1787367563.453280:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11544:x1874190425735936:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 4159us (5143us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787367563.453290:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1787367563.465081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367563.468622:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425736064 00000100:00100000:2.0:1787367563.468649:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425736064 00000100:00100000:2.0:1787367563.468759:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:2.0:1787367563.468772:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11544:x1874190425736064:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367563.468878:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468900:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468913:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468950:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468970:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468977:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.468984:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.468997:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.469006:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.469021:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367563.469024:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367563.469030:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.469035:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f43bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367563.469143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11544:x1874190425736064:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 373us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367563.469151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:2.0:1787367563.474172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.477016:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425736320 00000100:00100000:0.0:1787367563.477037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425736320 00000100:00100000:0.0:1787367563.477126:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:0.0:1787367563.477136:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11544:x1874190425736320:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1787367563.477470:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:11544:x1874190425736320:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 333us (3312us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787367563.477479:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1787367563.538093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.538274:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425736576 00000100:00100000:0.0:1787367563.538290:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425736576 00000100:00100000:0.0:1787367563.538377:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:0.0:1787367563.538389:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:11078:x1874190425736576:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367563.538435:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367563.538478:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f43c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cca expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.538621:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.538641:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.538652:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.538698:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.538716:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 28 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.538752:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446701056:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367563.538886:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367563.540738:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446701056:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367563.540780:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367563.543059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.543290:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425736704 00000100:00100000:0.0:1787367563.543303:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425736704 00010000:00010000:0.0:1787367563.543364:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 29 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.543650:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:0.0:1787367563.543667:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2356:x1874190425736704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367563.543691:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367563.543705:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 29 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.543723:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 29 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.543756:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f43ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cc3 expref: 29 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.543781:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367563.543788:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.543799:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.543831:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.544108:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367563.544256:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:2356:x1874190425736704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 591us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367563.544265:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00010000:00010000:2.0:1787367563.545389:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.545406:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367563.545434:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787367563.545660:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599e00/0xcbf1f1bac53f43c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 29 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.545686:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 28 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.545696:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367563.545699:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367563.545703:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:2.0:1787367563.545777:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:11078:x1874190425736576:12345-192.168.204.23@tcp:101:bash.0 Request processed in 7389us (7700us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787367563.545787:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:2.0:1787367563.552275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.552369:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425736960 00000100:00100000:3.0:1787367563.552384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425736960 00000100:00100000:3.0:1787367563.552466:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:3.0:1787367563.552477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:11078:x1874190425736960:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:3.0:1787367563.552824:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.552846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.552859:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367563.552946:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787367563.552975:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031377f39 reply state 00000000fbe49db0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367563.552996:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787367563.553051:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787367563.553177:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11078:x1874190425736960:12345-192.168.204.23@tcp:36:bash.0 Request processed in 700us (916us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787367563.553187:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 192 00000020:00080000:3.0:1787367563.553240:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787367563.557048:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557075:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557084:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557115:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.557122:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557143:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557165:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367563.557169:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367563.557175:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.557181:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f43d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367563.557808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.558048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737088 00000100:00100000:3.0:1787367563.558063:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737088 00000100:00100000:3.0:1787367563.558138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:3.0:1787367563.558149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11078:x1874190425737088:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367563.558179:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367563.558226:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f43df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cd1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.558304:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f43df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd1 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.558320:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f43df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd1 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.558343:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367563.558346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367563.558349:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e400, rc 0) 00000100:00100000:3.0:1787367563.558457:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11078:x1874190425737088:12345-192.168.204.23@tcp:101:bash.0 Request processed in 309us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367563.558466:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:1.0:1787367563.563997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.564142:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737216 00000100:00100000:0.0:1787367563.564155:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737216 00000100:00100000:0.0:1787367563.564341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:0.0:1787367563.564354:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:11078:x1874190425737216:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367563.564380:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367563.564412:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cd8 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367563.564451:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a891089, atime: 0x6a891088, ctime: 0x6a891089, blocks: 0xb 00010000:00010000:0.0:1787367563.564482:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1787367563.564488:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367563.564499:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.564520:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.564536:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599e00, rc 0) 00000100:00100000:0.0:1787367563.564619:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:11078:x1874190425737216:12345-192.168.204.23@tcp:101:bash.0 Request processed in 267us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367563.564645:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:1.0:1787367563.568030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.568150:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737344 00000100:00100000:3.0:1787367563.568164:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737344 00002000:00010000:3.0:1787367563.568272:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787367563.568279:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fb38c4380 with x1874190425737344 ext(0->18446744073709551615) 00002000:00010000:3.0:1787367563.568296:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fb38c4380. 00000100:00100000:3.0:1787367563.568338:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1787367563.568348:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425737344:12345-192.168.204.23@tcp:10:bash.0 00002000:00010000:3.0:1787367563.568733:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787367563.568738:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787367561 -> 1787367563 00002000:00010000:3.0:1787367563.568741:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787367560 -> 1787367560 00002000:00010000:3.0:1787367563.568744:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787367561 -> 1787367563 00002000:00010000:3.0:1787367563.568746:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787367563.568833:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425737344:12345-192.168.204.23@tcp:10:bash.0 Request processed in 485us (817us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787367563.568843:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00002000:00010000:3.0:1787367563.568848:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787367563.568852:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fb38c4380 with x1874190425737344 ext(0->18446744073709551615) 00002000:00010000:3.0:1787367563.568857:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fb38c4380. 00000100:00100000:2.0:1787367563.612886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.613123:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737472 00000100:00100000:0.0:1787367563.613263:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737472 00000100:00100000:0.0:1787367563.613414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 194 00000100:00100000:0.0:1787367563.613428:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11558:x1874190425737472:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:0.0:1787367563.613554:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.613579:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.613593:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.613615:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.613625:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.613632:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614065:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614076:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614084:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787367563.614165:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614181:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614188:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614237:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614245:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367563.614249:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614259:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614278:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367563.614282:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367563.614291:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614299:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599c00/0xcbf1f1bac53f43ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614318:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614324:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614339:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614345:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367563.614348:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614355:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614364:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f83c18000) 00010000:00010000:0.0:1787367563.614366:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367563.614370:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614375:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f43f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614392:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614398:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614404:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614410:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367563.614413:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614429:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614437:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367563.614439:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367563.614442:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.614448:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f43fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.614574:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11558:x1874190425737472:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1146us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367563.614584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 194 00000100:00100000:1.0:1787367563.643661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.643867:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737728 00000100:00100000:3.0:1787367563.643883:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737728 00000100:00100000:3.0:1787367563.643966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:3.0:1787367563.643978:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+32:11561:x1874190425737728:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367563.644377:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367563.644427:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cdf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644661:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644683:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644698:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644718:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644726:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.644733:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645447:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645528:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645539:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367563.645553:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787367563.645728:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645748:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645756:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645763:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367563.645768:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645776:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645792:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367563.645796:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367563.645801:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645824:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645830:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645836:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.645842:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367563.645982:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646002:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646012:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f91b61b00) 00010000:00010000:3.0:1787367563.646112:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367563.646117:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646124:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646186:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f4402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cdf expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646262:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cdf expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.646270:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367563.646272:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787367563.646274:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f800, rc 0) 00000100:00100000:3.0:1787367563.646372:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11561:x1874190425737728:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2395us (2726us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787367563.646383:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:1.0:1787367563.650137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.650388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425737856 00000100:00100000:3.0:1787367563.650402:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425737856 00000100:00100000:2.0:1787367563.650925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:2.0:1787367563.650941:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11561:x1874190425737856:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367563.651121:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.651242:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 34 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.651254:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.651299:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 34 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.651335:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 34 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367563.651353:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446701184:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367563.651537:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367563.653993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.654053:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb397480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446701184:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367563.654093:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367563.654244:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425738112 00000100:00100000:3.0:1787367563.654258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425738112 00000100:00100000:3.0:1787367563.654355:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:3.0:1787367563.654366:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:5595:x1874190425738112:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787367563.654938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:5595:x1874190425738112:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 571us (964us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787367563.654948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:1.0:1787367563.660968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.661095:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425738240 00000100:00100000:3.0:1787367563.661110:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425738240 00010000:00010000:3.0:1787367563.661168:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 36 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367563.661257:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1787367563.661270:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:2357:x1874190425738240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367563.661291:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367563.661300:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 36 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661316:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 36 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661345:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f43ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cca expref: 36 pid: 6718 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661366:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367563.661372:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661384:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661414:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.661445:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367563.661555:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:2357:x1874190425738240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 272us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367563.661564:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00010000:00010000:0.0:1787367563.661768:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661778:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661822:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661830:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661851:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661859:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367563.661864:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661873:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661884:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367563.661888:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367563.661892:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.661900:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.661952:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11561:x1874190425737856:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 11015us (11831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367563.661962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:2.0:1787367563.664524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.664708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425738496 00000100:00100000:3.0:1787367563.664722:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425738496 00000100:00100000:3.0:1787367563.664800:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1787367563.664812:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+34:11561:x1874190425738496:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1787367563.665154:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:11561:x1874190425738496:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 343us (644us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787367563.665163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1787367563.729331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367563.733082:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425738752 00000100:00100000:2.0:1787367563.733109:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425738752 00000100:00100000:2.0:1787367563.733236:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:2.0:1787367563.733251:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+35:11572:x1874190425738752:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1787367563.733292:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367563.733323:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f442c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ce6 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.734993:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.735023:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.735041:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.735063:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.735071:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.735098:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736416:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736435:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736448:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367563.736471:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787367563.736628:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736637:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736645:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736657:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.736664:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736674:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736689:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367563.736693:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367563.736709:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736717:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736734:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736742:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736748:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736755:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367563.736758:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736764:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736772:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367563.736775:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367563.736778:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736784:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f443a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736867:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f442c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ce6 expref: 38 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736902:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ce6 expref: 37 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.736911:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367563.736914:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367563.736916:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367563.737048:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11572:x1874190425738752:12345-192.168.204.23@tcp:101:cat.0 Request processed in 3799us (7731us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787367563.737060:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:0.0:1787367563.745834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.746592:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739008 00000100:00100000:3.0:1787367563.746608:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739008 00000100:00100000:3.0:1787367563.746711:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:3.0:1787367563.746724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11572:x1874190425739008:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1787367563.747115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:11572:x1874190425739008:12345-192.168.204.23@tcp:35:cat.0 Request processed in 392us (1298us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787367563.749850:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1787367563.786279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.786427:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739264 00000100:00100000:0.0:1787367563.786444:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739264 00000100:00100000:0.0:1787367563.786550:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 198 00000100:00100000:0.0:1787367563.786564:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:11573:x1874190425739264:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1787367563.786651:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787367563.786692:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ce6 expref: 38 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.787977:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cdf expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.788005:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f43df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd1 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.788436:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367563.788458:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367563.790085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790128:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790144:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790171:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790186:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790779:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790798:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.790807:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367563.795161:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787367563.795181:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369070987990ns, next at 370070983950ns, rc = 0 00010000:00010000:1.0:1787367563.795329:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795354:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795367:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795378:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795386:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795393:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795418:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367563.795449:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795455:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795470:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795476:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.795481:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795489:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795504:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97600) 00010000:00010000:1.0:1787367563.795507:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787367563.795513:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795520:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f445d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795546:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795553:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795559:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795564:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.795567:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795584:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795593:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367563.795595:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367563.795599:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.795603:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f444f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367563.795616:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e483f2b7 reply state 000000008bda3472 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367563.795627:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367563.795760:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+37:11573:x1874190425739264:12345-192.168.204.23@tcp:36:rm.0 Request processed in 9193us (9495us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787367563.795770:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 198 00010000:00010000:2.0:1787367563.796538:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367563.796548:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.796558:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fe00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367563.796573:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.796581:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.796594:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9e8f86d97600) 00010000:00010000:2.0:1787367563.796597:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787367563.796600:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.796606:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4464 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.796632:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367563.796646:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367563.796649:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367563.798590:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798608:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798615:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798621:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367563.798626:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798650:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798668:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97400) 00010000:00010000:1.0:1787367563.798671:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367563.798675:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.798681:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4456 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367563.888730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367563.888825:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739520 00000100:00100000:3.0:1787367563.888839:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739520 00000100:00100000:3.0:1787367563.888903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:3.0:1787367563.888916:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+36:11579:x1874190425739520:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1787367563.888968:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367563.889005:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f446b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ced expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889173:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889219:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889234:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889253:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889260:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.889268:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367563.889907:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787367563.890499:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890517:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890528:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890590:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890598:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890605:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890612:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ec00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367563.890617:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890625:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890642:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367563.890645:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367563.890651:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.890658:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4472 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367563.890677:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000348d275c reply state 00000000144b4951 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367563.890686:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787367563.893509:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f446b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.893566:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.893578:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:3.0:1787367563.893581:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367563.893586:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e400, rc 0) 00000100:00100000:2.0:1787367563.894117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+39:11579:x1874190425739520:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5198us (5395us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787367563.894130:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:3.0:1787367563.898496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1787367563.898543:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898559:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898569:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898576:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367563.898581:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898591:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898615:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f91b61b00) 00010000:00010000:3.0:1787367563.898619:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367563.898625:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.898633:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.898716:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739648 00000100:00100000:0.0:1787367563.898731:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739648 00000100:00100000:0.0:1787367563.898805:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:0.0:1787367563.898817:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425739648:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367563.898845:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367563.898872:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cf4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787367563.899034:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787367563.899368:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1787367563.899375:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367563.899390:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.899417:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.899454:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599c00, rc 0) 00000100:00100000:0.0:1787367563.899547:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425739648:12345-192.168.204.23@tcp:101:bash.0 Request processed in 731us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367563.899555:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:0.0:1787367563.906639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367563.907369:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739776 00000100:00100000:1.0:1787367563.907386:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739776 00000100:00100000:1.0:1787367563.907947:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1787367563.907962:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:11579:x1874190425739776:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1787367563.908000:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367563.908028:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5cfb expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.908073:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.908084:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367563.908089:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367563.908096:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.908141:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367563.908170:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367563.908182:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367563.908348:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446701312:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367563.909091:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367563.912317:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8211:1874190446701312:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367563.912371:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367563.912557:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fa00, rc 0) 00000100:00100000:2.0:1787367563.912903:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:11579:x1874190425739776:12345-192.168.204.23@tcp:101:bash.0 Request processed in 4943us (6278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367563.912914:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1787367563.913865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367563.914076:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425739904 00000100:00100000:0.0:1787367563.914088:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425739904 00010000:00010000:0.0:1787367563.914135:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.914320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1787367563.914333:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425739904:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367563.914352:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367563.914380:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.914407:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.914445:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056afc6dd/0xcbf1f1bac53f448e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cf4 expref: 9 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.914466:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367563.914472:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367563.914500:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.914513:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367563.914565:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367563.914689:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1874190446701440:192.168.204.23@tcp:105: 00000100:00100000:0.0:1787367563.914878:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6180 going to sleep for 11 seconds 00000001:00080000:1.0:1787367563.917155:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1787367563.917182:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1787367563.920114:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1874190446701440:192.168.204.23@tcp:105: 00010000:00010000:1.0:1787367563.920159:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367563.920303:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425739904:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5971us (6442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367563.920317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1787367563.922904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367563.923025:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425740160 00000100:00100000:1.0:1787367563.923039:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425740160 00000100:00100000:1.0:1787367563.923440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:1.0:1787367563.923454:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+38:11579:x1874190425740160:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1787367563.924075:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+39:11579:x1874190425740160:12345-192.168.204.23@tcp:35:bash.0 Request processed in 621us (1356us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787367563.924086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:2.0:1787367564.134620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.134965:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425740288 00000100:00100000:0.0:1787367564.134988:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425740288 00000100:00100000:0.0:1787367564.135068:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:0.0:1787367564.135081:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+39:11595:x1874190425740288:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367564.135112:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367564.135139:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f449c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d02 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135277:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135296:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135309:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367564.135406:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787367564.135411:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367564.135436:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135466:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f449c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d02 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135487:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d02 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.135496:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367564.135500:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367564.135504:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599000, rc 0) 00000100:00100000:0.0:1787367564.135578:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11595:x1874190425740288:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 500us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367564.135585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:0.0:1787367564.145281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.145424:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425740544 00000100:00100000:2.0:1787367564.145437:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425740544 00000100:00100000:2.0:1787367564.145516:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:2.0:1787367564.145527:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+40:11595:x1874190425740544:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.145557:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.145598:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f44aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d09 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.145740:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f44b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.145757:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f44b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.145789:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f44b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.145803:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787367564.145961:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f44aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d09 expref: 43 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.145994:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f44b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d09 expref: 42 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.146005:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:2.0:1787367564.146009:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367564.146013:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:2.0:1787367564.146101:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+42:11595:x1874190425740544:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 576us (837us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787367564.146110:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:2.0:1787367564.163478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.163537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.163727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425740800 00000100:00100000:0.0:1787367564.163740:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425740800 00000100:00100000:0.0:1787367564.163817:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 202 00000100:00100000:0.0:1787367564.163829:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+42:11595:x1874190425740800:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367564.163865:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367564.163892:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f44bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d10 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.164038:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.164074:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.164089:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367564.164105:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787367564.164314:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f44bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d10 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.164336:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d10 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.164539:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:0.0:1787367564.164543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787367564.164548:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598000, rc 0) 00000100:00100000:0.0:1787367564.164737:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+44:11595:x1874190425740800:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 910us (1274us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787367564.164746:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 202 00000100:00100000:3.0:1787367564.164776:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425740928 00000100:00100000:3.0:1787367564.164783:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425740928 00000100:00100000:3.0:1787367564.164841:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1787367564.164851:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+44:2357:x1874190425740928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367564.164867:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367564.164889:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f44b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d09 expref: 44 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.164905:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:3.0:1787367564.164909:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367564.164945:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92393850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:2357:x1874190425740928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.164955:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:2.0:1787367564.173385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.173585:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741056 00000100:00100000:1.0:1787367564.173598:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741056 00000100:00100000:1.0:1787367564.173692:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:1.0:1787367564.173705:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+6:2356:x1874190425741056:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1787367564.173790:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.173818:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.173829:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367564.173834:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367564.173840:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.173889:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 6 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.173906:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 6 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.173924:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446701568:192.168.204.23@tcp:104: 00000100:00080000:0.0:1787367564.174097:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367564.174305:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e80300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367564.182695:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae74700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1874190446701568:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367564.182738:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.183102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.183172:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741184 00000100:00100000:1.0:1787367564.183183:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741184 00002000:00100000:1.0:1787367564.183493:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e8f904a3100 x1874190425741184/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:205/0 lens 504/0 e 0 to 0 dl 1787367575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367564.183505:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f904a3100 with x1874190425741184 ext(0->8) 00010000:00010000:1.0:1787367564.183514:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 7 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.183553:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 7 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367564.183562:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f904a3100 00000100:00100000:1.0:1787367564.183650:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367564.183662:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425741184:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:1.0:1787367564.184445:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425741184:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 779us (1340us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787367564.184456:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00002000:00100000:1.0:1787367564.184465:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9e8f904a3100 x1874190425741184/t4294967308(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:205/0 lens 504/448 e 0 to 0 dl 1787367575 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367564.184475:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8f904a3100 with x1874190425741184 ext(0->8) 00010000:00010000:1.0:1787367564.184483:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.184499:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367564.184513:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e8f904a3100 00000100:00100000:1.0:1787367564.194327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.195040:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741312 00000100:00100000:0.0:1787367564.195055:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741312 00010000:00010000:0.0:1787367564.195117:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.195235:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:0.0:1787367564.195248:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2358:x1874190425741312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367564.195292:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787367564.195317:0:7633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787367564.195321:0:7633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787367564 00002000:00010000:0.0:1787367564.195324:0:7633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787367564 00002000:00010000:0.0:1787367564.195326:0:7633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787367564 00010000:00010000:0.0:1787367564.195334:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.195352:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.195381:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae7b50a2/0xcbf1f1bac53f4495 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cfb expref: 9 pid: 8211 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.195402:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367564.195407:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367564.195414:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.195438:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.195479:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367564.195560:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2358:x1874190425741312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 315us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367564.195570:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00010000:00010000:2.0:1787367564.195615:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195645:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195678:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195688:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195697:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195705:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367564.195710:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195719:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195733:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.195742:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006090be04/0xcbf1f1bac53f44d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.195841:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425741056:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 22138us (22472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.195850:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:1.0:1787367564.200982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.201674:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741568 00000100:00100000:3.0:1787367564.201689:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741568 00000100:00100000:3.0:1787367564.201812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:3.0:1787367564.201825:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+43:11595:x1874190425741568:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:3.0:1787367564.201928:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d10 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367564.202330:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787367564.205019:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787367564.206280:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787367564.206391:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.206422:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.206434:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.206491:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.206512:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 47 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.206530:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874190446701696:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367564.206659:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f9a697c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367564.213797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.213916:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1874190446701696:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367564.213953:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.214105:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741696 00000100:00100000:1.0:1787367564.214123:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741696 00010000:00010000:1.0:1787367564.214172:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 48 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.214914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:2.0:1787367564.214941:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+48:2357:x1874190425741696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367564.214963:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367564.214987:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 48 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215003:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 48 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215033:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ced expref: 48 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215054:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:2.0:1787367564.215060:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215072:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215081:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.215122:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367564.215382:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+47:2357:x1874190425741696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 445us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.215392:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00010000:00010000:3.0:1787367564.220014:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.220066:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367564.220364:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787367564.220729:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787367564.220895:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446701824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787367564.221001:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367564.221100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446701824 00000100:00100000:1.0:1787367564.221113:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446701824 00000100:00100000:1.0:1787367564.221229:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367564.221240:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874190446701824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787367564.221372:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367564.221396:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0355480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367564.221430:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787367564.221437:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787367564.221463:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb38c6a00, transno 4294967307 00000100:00100000:2.0:1787367564.221530:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf402d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446701824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787367564.222103:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787367564.222106:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874190446701824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 866us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.222116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367564.222183:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446701952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787367564.224393:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367564.224459:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0355900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367564.225256:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446701952 00000100:00100000:1.0:1787367564.225269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446701952 00000100:00100000:1.0:1787367564.225341:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367564.225353:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1874190446701952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787367564.225622:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1874190446701952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (1238us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787367564.225632:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787367564.225780:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1874190446701952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787367564.225875:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787367564.225933:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.225945:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.225953:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.225960:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367564.225967:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.225988:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.226009:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:3.0:1787367564.226013:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787367564.226020:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.226051:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f44db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367564.226321:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787367564.226436:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787367564.226452:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369502258709ns, next at 370502254709ns, rc = 0 00000001:00080000:3.0:1787367564.226461:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787367564.226502:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f91b61800) 00010000:00010000:3.0:1787367564.226505:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787367564.226514:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598000/0xcbf1f1bac53f44c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d10 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.226652:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:11595:x1874190425741568:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 24830us (25695us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787367564.226662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000020:00080000:3.0:1787367564.226667:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787367564.229449:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.229532:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425741824 00000100:00100000:2.0:1787367564.229545:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425741824 00000100:00100000:2.0:1787367564.229621:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:2.0:1787367564.229633:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+50:11595:x1874190425741824:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.229664:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.229695:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f44e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d17 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.229775:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f44e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d17 expref: 51 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.229791:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f44e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d17 expref: 51 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.229815:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.229818:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367564.229822:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75200, rc 0) 00000100:00100000:2.0:1787367564.229901:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11595:x1874190425741824:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 270us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.229909:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:0.0:1787367564.235598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.235781:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425742080 00000100:00100000:1.0:1787367564.235795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425742080 00000100:00100000:1.0:1787367564.235937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1787367564.235950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+51:11595:x1874190425742080:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1787367564.237302:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11595:x1874190425742080:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 1343us (1707us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787367564.237315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1787367564.317060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.317518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425742208 00000100:00100000:1.0:1787367564.317534:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425742208 00000100:00100000:1.0:1787367564.317642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:1.0:1787367564.317653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11605:x1874190425742208:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:1.0:1787367564.317801:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.317838:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.317853:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.317874:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.317884:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.317892:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318039:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318049:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318056:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367564.318488:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318508:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318531:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318539:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318547:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367564.318553:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318562:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318577:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367564.318581:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367564.318586:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318593:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f44e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318612:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318618:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318625:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318631:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367564.318640:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318647:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97700) 00010000:00010000:1.0:1787367564.318659:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367564.318663:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318669:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f44f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318687:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318693:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318700:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318705:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367564.318709:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318716:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318724:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.318727:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367564.318738:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.318745:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f44f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.319102:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11605:x1874190425742208:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1441us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.319341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:2.0:1787367564.364725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.365140:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425742464 00000100:00100000:0.0:1787367564.365161:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425742464 00000100:00100000:2.0:1787367564.365505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:2.0:1787367564.365548:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+52:11608:x1874190425742464:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.365579:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.365613:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f44fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d1e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365736:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365756:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365791:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365798:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.365806:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.366416:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.366433:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.366445:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.366734:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787367564.367353:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367364:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367377:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367914:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.367927:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367941:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367963:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367564.367967:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.367981:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.367989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4505 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368011:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368034:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368064:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368070:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.368074:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368081:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368091:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367564.368094:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.368097:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368104:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f450c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368552:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f44fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368570:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.368578:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.368580:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367564.368583:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74000, rc 0) 00000100:00100000:2.0:1787367564.368704:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11608:x1874190425742464:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3160us (3993us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787367564.368730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:0.0:1787367564.375484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.375586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425742592 00000100:00100000:2.0:1787367564.375601:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425742592 00000100:00100000:2.0:1787367564.375689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:2.0:1787367564.375702:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11608:x1874190425742592:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367564.375809:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375844:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375860:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375896:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375904:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375912:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375919:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.375924:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375933:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375949:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.375981:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367564.375987:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.375995:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.376103:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11608:x1874190425742592:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 403us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.376347:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:3.0:1787367564.379847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.380664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425742848 00000100:00100000:2.0:1787367564.380682:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425742848 00000100:00100000:2.0:1787367564.380817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:2.0:1787367564.380829:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+54:11608:x1874190425742848:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367564.381365:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11608:x1874190425742848:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 535us (1543us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787367564.381374:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:0.0:1787367564.456893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.457106:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425743104 00000100:00100000:2.0:1787367564.457131:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425743104 00000100:00100000:2.0:1787367564.457253:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:2.0:1787367564.457265:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11618:x1874190425743104:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367564.457307:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.457311:0:6718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787367564.457364:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599000/0xcbf1f1bac53f44a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d02 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457389:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367564.457396:0:6718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367564.457439:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4528 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d25 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457625:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457643:0:6718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457655:0:6718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457702:0:6718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.457720:0:6718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 55 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.458039:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446702080:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367564.458187:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0355480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367564.470989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.471277:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6718:1874190446702080:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367564.471319:0:6718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.472323:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425743232 00000100:00100000:1.0:1787367564.472336:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425743232 00010000:00010000:1.0:1787367564.472404:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.472502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:1.0:1787367564.472515:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+56:2356:x1874190425743232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367564.472539:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367564.472548:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472577:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472609:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74000/0xcbf1f1bac53f4513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d1e expref: 56 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472631:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.472637:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472680:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472691:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.472733:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367564.472835:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:2356:x1874190425743232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 322us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.472845:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00010000:00010000:2.0:1787367564.473996:0:6718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.474012:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.474062:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787367564.474319:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4528 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 56 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.474342:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 55 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.474352:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.474355:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787367564.474359:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74600, rc 0) 00000100:00100000:2.0:1787367564.474438:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11618:x1874190425743104:12345-192.168.204.23@tcp:101:bash.0 Request processed in 17174us (17565us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787367564.474447:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:0.0:1787367564.479539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.480020:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425743488 00000100:00100000:2.0:1787367564.480037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425743488 00000100:00100000:2.0:1787367564.480121:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:2.0:1787367564.480134:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+55:11618:x1874190425743488:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:3.0:1787367564.486501:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.486538:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.486555:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367564.486760:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787367564.486901:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bec4da21 reply state 000000000d5c4e5a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.486915:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787367564.487116:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11618:x1874190425743488:12345-192.168.204.23@tcp:36:bash.0 Request processed in 6976us (7587us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787367564.487127:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 208 00000020:00080000:3.0:1787367564.487135:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787367564.492896:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.492921:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.492929:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.492936:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367564.492942:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.492952:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.492985:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.492989:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367564.492994:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.493027:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f453d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.495677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.497264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425743616 00000100:00100000:2.0:1787367564.497287:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425743616 00000100:00100000:2.0:1787367564.497432:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:2.0:1787367564.497446:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11618:x1874190425743616:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367564.497481:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.497511:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4544 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.497644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.497689:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 58 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.497700:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.497751:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 58 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.497767:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 58 pid: 6718 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.497785:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446702208:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367564.497920:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0355840 going to sleep for 11 seconds 00000100:00100000:2.0:1787367564.502474:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446702208:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367564.502521:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.503675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.503871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425743744 00000100:00100000:2.0:1787367564.503887:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425743744 00010000:00010000:2.0:1787367564.503939:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 59 pid: 6718 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.504001:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:2.0:1787367564.504013:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:2357:x1874190425743744:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367564.504036:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367564.504060:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 59 pid: 6718 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504075:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 59 pid: 6718 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504104:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f452f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d25 expref: 59 pid: 6718 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504125:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.504131:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504143:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504153:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.504240:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367564.504321:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:2357:x1874190425743744:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 309us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.504330:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00010000:00010000:3.0:1787367564.506239:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.506264:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367564.506341:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787367564.506348:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367564.506376:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.506425:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f4544 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.506450:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.506462:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367564.506465:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787367564.506469:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75c00, rc 0) 00000100:00100000:3.0:1787367564.506568:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11618:x1874190425743616:12345-192.168.204.23@tcp:101:bash.0 Request processed in 9125us (10907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.506577:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:0.0:1787367564.509920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.512896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744000 00000100:00100000:1.0:1787367564.512916:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744000 00000100:00100000:1.0:1787367564.513029:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:1.0:1787367564.513041:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+57:11618:x1874190425744000:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1787367564.513520:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11618:x1874190425744000:12345-192.168.204.23@tcp:35:bash.0 Request processed in 479us (3613us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787367564.513530:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:0.0:1787367564.614865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.616424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744128 00000100:00100000:3.0:1787367564.617122:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744128 00000100:00100000:2.0:1787367564.618902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:2.0:1787367564.618923:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+58:11624:x1874190425744128:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.618977:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.619007:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d33 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619135:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619156:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619170:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.619401:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787367564.619406:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367564.619452:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619488:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d33 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619514:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d33 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.619524:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367564.619527:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367564.619531:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75e00, rc 0) 00000100:00100000:2.0:1787367564.619627:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425744128:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 709us (4777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.619635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:0.0:1787367564.623154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.624677:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744256 00000100:00100000:2.0:1787367564.624700:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744256 00000100:00100000:2.0:1787367564.624833:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:2.0:1787367564.624845:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425744256:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.624873:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.624901:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4560 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d3a expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625010:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625033:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625047:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625069:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625077:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625084:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625339:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625350:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625357:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.625417:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787367564.625422:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367564.625446:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625461:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625541:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625549:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625557:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625563:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.625568:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625577:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625592:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367564.625596:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.625601:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625609:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f4567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625638:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625645:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625651:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625657:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.625660:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625666:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625676:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367564.625678:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.625682:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625688:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f456e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625733:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4560 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d3a expref: 61 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625749:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d3a expref: 60 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.625770:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.625773:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367564.625781:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74200, rc 0) 00000100:00100000:2.0:1787367564.625884:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11624:x1874190425744256:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1040us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.625894:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:0.0:1787367564.643259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.644426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.644614:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744640 00000100:00100000:1.0:1787367564.644628:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744640 00000100:00100000:1.0:1787367564.644719:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1787367564.644736:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:2356:x1874190425744640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367564.644760:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787367564.644795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744512 00010000:00010000:1.0:1787367564.644795:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f4575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d3a expref: 60 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.644801:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744512 00010000:00010000:1.0:1787367564.644819:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.644826:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367564.644835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:3.0:1787367564.644853:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11624:x1874190425744512:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367564.644876:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367564.644900:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f457c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d41 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.644906:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:2356:x1874190425744640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 173us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.644914:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00010000:00010000:3.0:1787367564.645065:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.645083:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.645093:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.645138:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.645155:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 60 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.645172:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446702336:192.168.204.23@tcp:104: 00000100:00100000:3.0:1787367564.645301:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85533cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367564.649708:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446702336:192.168.204.23@tcp:104: 00010000:00010000:3.0:1787367564.649754:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.652932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.653331:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425744768 00000100:00100000:0.0:1787367564.653346:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425744768 00010000:00010000:0.0:1787367564.653414:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 61 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.653470:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:0.0:1787367564.653483:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:2357:x1874190425744768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367564.653507:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367564.653516:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 61 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653531:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 61 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653611:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f454b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d2c expref: 61 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653637:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367564.653643:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653654:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653662:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.653705:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367564.653804:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:2357:x1874190425744768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 323us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367564.653813:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00010000:00010000:1.0:1787367564.653954:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.653985:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367564.654010:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787367564.654345:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f457c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.654368:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.654378:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.654382:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367564.654385:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:1.0:1787367564.654425:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11624:x1874190425744512:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9583us (11249us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787367564.654433:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:0.0:1787367564.658480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.658580:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745024 00000100:00100000:1.0:1787367564.658594:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745024 00000100:00100000:1.0:1787367564.658680:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1787367564.658692:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11624:x1874190425745024:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:1.0:1787367564.658714:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367564.658748:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75200/0xcbf1f1bac53f44e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d17 expref: 60 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.658773:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367564.658780:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367564.658890:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92392050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425745024:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 201us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.658900:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1787367564.661568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.661659:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745152 00000100:00100000:3.0:1787367564.661673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745152 00000100:00100000:3.0:1787367564.661750:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:3.0:1787367564.661762:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425745152:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:3.0:1787367564.661944:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.661976:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.661990:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787367564.662453:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787367564.662975:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425745152:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 1201us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.662987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:1.0:1787367564.665520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.665879:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745280 00000100:00100000:2.0:1787367564.666021:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745280 00000100:00100000:2.0:1787367564.666568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:2.0:1787367564.666581:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+59:11624:x1874190425745280:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367564.666612:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.666641:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d48 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666726:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666741:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666767:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666783:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666802:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.666824:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367564.666829:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.666838:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367564.667152:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11624:x1874190425745280:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 571us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.667162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 214 00000040:00080000:3.0:1787367564.739589:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367564.739603:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367564.739653:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787367564.739661:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367564.739874:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446702464:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367564.741602:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367564.754344:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3900380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446702464:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367564.755251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.755405:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745408 00000100:00100000:2.0:1787367564.755416:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745408 00000100:00100000:2.0:1787367564.755495:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:2.0:1787367564.755508:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11625:x1874190425745408:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367564.755553:0:6718:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367564.755696:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11625:x1874190425745408:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 191us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.755706:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:1.0:1787367564.760030:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.761863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745536 00000100:00100000:3.0:1787367564.761883:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745536 00000100:00100000:3.0:1787367564.762532:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:3.0:1787367564.762549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11625:x1874190425745536:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787367564.762746:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762840:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762862:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762882:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762891:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762897:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762930:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762940:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.762947:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367564.763026:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787367564.763032:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367564.763050:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763081:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763088:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763096:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763306:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367564.763314:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763324:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763417:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:3.0:1787367564.763421:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367564.763429:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763436:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f459f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763457:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763464:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763469:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763482:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367564.763486:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763493:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763502:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9e8f91b61800) 00010000:00010000:3.0:1787367564.763505:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367564.763508:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763514:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f45a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763534:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763540:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763545:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763550:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367564.763552:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763558:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763576:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367564.763578:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367564.763582:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.763588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.763856:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11625:x1874190425745536:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 1308us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.763867:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:0.0:1787367564.769078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.769254:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745792 00000100:00100000:2.0:1787367564.769267:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745792 00000100:00100000:2.0:1787367564.769345:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:2.0:1787367564.769358:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+60:11625:x1874190425745792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367564.769388:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.769416:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d4f expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769576:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769597:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769638:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367564.769655:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787367564.769800:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769809:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769816:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769823:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.769828:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769836:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769850:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367564.769853:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367564.769859:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769865:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769921:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45b4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d4f expref: 62 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769946:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:2.0:1787367564.769949:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367564.769953:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d4f expref: 62 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.769974:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367564.770680:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425745792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1319us (1624us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787367564.770690:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:1.0:1787367564.782760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.782991:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425745920 00000100:00100000:0.0:1787367564.783007:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425745920 00000100:00100000:0.0:1787367564.783264:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:0.0:1787367564.783278:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425745920:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787367564.783335:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787367564.783476:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425745920:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 200us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367564.783485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:1.0:1787367564.787364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.787650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425746176 00000100:00100000:3.0:1787367564.787664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425746176 00000100:00100000:3.0:1787367564.787747:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:3.0:1787367564.787759:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425746176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787367564.787787:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367564.787791:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787367564.787829:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75e00/0xcbf1f1bac53f4559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d33 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.787853:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:3.0:1787367564.787860:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367564.787877:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787367564.788956:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787367564.790331:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.790360:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.790374:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.790461:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f000/0xcbf1f1bac53f45c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d56 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.790485:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d56 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.790494:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367564.790498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367564.790502:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75400, rc 0) 00000100:00100000:2.0:1787367564.791472:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11625:x1874190425746176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 2877us (3286us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787367564.791486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:1.0:1787367564.797906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.805573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425746432 00000100:00100000:3.0:1787367564.805624:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425746432 00000100:00100000:2.0:1787367564.806824:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:2.0:1787367564.806845:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11625:x1874190425746432:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787367564.806936:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367564.806995:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75400/0xcbf1f1bac53f45d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d56 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807024:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f829e0100) 00010000:00010000:2.0:1787367564.807041:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787367564.807072:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807090:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807101:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807121:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807137:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807320:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807345:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807352:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807359:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.807365:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807373:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807384:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:2.0:1787367564.807387:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.807391:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807398:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75000/0xcbf1f1bac53f45de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.807410:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808047:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808056:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808066:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367564.808084:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808092:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808103:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc15d166a (ffff9e8f8527a500) 00010000:00010000:2.0:1787367564.808106:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367564.808110:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.808116:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f45e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc15d166a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367564.808383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425746432:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1538us (10759us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787367564.808393:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:1.0:1787367564.818311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.818607:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425746560 00000100:00100000:0.0:1787367564.818622:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425746560 00000100:00100000:0.0:1787367564.818722:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 221 00000100:00100000:0.0:1787367564.818736:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+61:11625:x1874190425746560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367564.818766:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367564.818797:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d5d expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.818855:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.818875:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.818889:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.819037:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 63 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.819060:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 62 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.819070:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367564.819073:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787367564.819076:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367564.819336:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11625:x1874190425746560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 600us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367564.819346:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 221 00000100:00100000:3.0:1787367564.827556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.828438:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425746816 00000100:00100000:0.0:1787367564.828455:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425746816 00000100:00100000:0.0:1787367564.828539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:0.0:1787367564.828552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+62:11625:x1874190425746816:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367564.828956:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.828990:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.829003:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367564.829445:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787367564.829458:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370105264305ns, next at 371105261130ns, rc = 0 00000004:00010000:0.0:1787367564.830002:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053735556 reply state 00000000f178af4a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.830019:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367564.830402:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+64:11625:x1874190425746816:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1848us (2861us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787367564.830412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:0.0:1787367564.837170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.837418:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425746944 00000100:00100000:2.0:1787367564.837432:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425746944 00000100:00100000:2.0:1787367564.837506:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:2.0:1787367564.837519:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+64:11625:x1874190425746944:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367564.837559:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.837588:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d64 expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.837670:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 65 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.837688:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 65 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.837733:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:2.0:1787367564.837737:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367564.837742:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74600, rc 0) 00000100:00100000:2.0:1787367564.838280:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+65:11625:x1874190425746944:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 759us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.838290:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 223 00010000:00010000:3.0:1787367564.838463:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838474:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838483:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838490:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367564.838495:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838505:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838519:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:3.0:1787367564.838522:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787367564.838526:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.838532:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f45fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.840905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.841060:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425747072 00000100:00100000:1.0:1787367564.841076:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425747072 00000100:00080000:0.0:1787367564.841228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367564.841405:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1787367564.841416:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425747072:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787367564.841816:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2356:x1874190425747072:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 400us (927us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787367564.841833:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:0.0:1787367564.845504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.845646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425747328 00000100:00100000:2.0:1787367564.845661:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425747328 00000100:00100000:2.0:1787367564.845756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:2.0:1787367564.845770:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+64:11625:x1874190425747328:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787367564.846385:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+65:11625:x1874190425747328:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 615us (895us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787367564.846396:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:0.0:1787367564.849409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.849587:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425747584 00000100:00100000:2.0:1787367564.849600:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425747584 00000100:00100000:2.0:1787367564.849727:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:2.0:1787367564.849736:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+65:11625:x1874190425747584:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367564.849980:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+65:11625:x1874190425747584:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 243us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.849989:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:0.0:1787367564.853363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.853588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425747712 00000100:00100000:1.0:1787367564.853602:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425747712 00000100:00100000:1.0:1787367564.853773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:1.0:1787367564.853788:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+65:11625:x1874190425747712:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367564.853953:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367564.854003:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d6b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854118:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854162:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854178:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367564.854290:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367564.854317:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854350:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d6b expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854376:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d6b expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.854387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367564.854390:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787367564.854395:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fa00, rc 0) 00000100:00100000:1.0:1787367564.854490:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+66:11625:x1874190425747712:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 704us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.854500:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:0.0:1787367564.860575:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.860748:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425747840 00000100:00100000:2.0:1787367564.860764:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425747840 00000100:00100000:2.0:1787367564.860973:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:2.0:1787367564.860987:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+10:2358:x1874190425747840:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367564.861039:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367564.861074:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d72 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367564.861130:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89108d, blocks: 0x1 00010000:00010000:2.0:1787367564.861164:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1787367564.861170:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367564.861185:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.861271:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.861289:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:2.0:1787367564.861372:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:2358:x1874190425747840:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 388us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367564.861381:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1787367564.865485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.865897:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748096 00000100:00100000:1.0:1787367564.865915:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748096 00000100:00100000:1.0:1787367564.866011:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 226 00000100:00100000:1.0:1787367564.866025:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+66:11625:x1874190425748096:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787367564.866257:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+66:11625:x1874190425748096:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 221us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.866278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 226 00000100:00100000:0.0:1787367564.869547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.869666:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748224 00000100:00100000:1.0:1787367564.869680:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748224 00000100:00100000:1.0:1787367564.869813:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:1.0:1787367564.869840:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:11625:x1874190425748224:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367564.869875:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367564.869906:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d79 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.869968:0:8211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.869980:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367564.869986:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367564.869993:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 12 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.870047:0:8211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.870068:0:8211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367564.870089:0:8211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf59f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8211:1874190446702592:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367564.870298:0:8211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e80300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367564.874383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367564.874399:0:8211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf59f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8211:1874190446702592:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367564.874453:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 12 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367564.874483:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00100000:1.0:1787367564.874571:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:11625:x1874190425748224:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 4745us (5039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367564.874584:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:3.0:1787367564.874592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748352 00000100:00100000:3.0:1787367564.874603:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748352 00010000:00010000:3.0:1787367564.874791:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.874835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:3.0:1787367564.874953:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:2356:x1874190425748352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367564.874986:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367564.875544:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.875569:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.875599:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f02df5c/0xcbf1f1bac53f4616 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d72 expref: 12 pid: 6696 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.875620:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367564.875625:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367564.875636:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 11 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.875648:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 11 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367564.875703:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 11 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367564.875720:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446702720:192.168.204.23@tcp:105: 00000100:00100000:3.0:1787367564.875878:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367564.878929:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1874190446702720:192.168.204.23@tcp:105: 00010000:00010000:3.0:1787367564.878998:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367564.879084:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:2356:x1874190425748352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4133us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.879112:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:1.0:1787367564.883543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.883732:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748480 00000100:00100000:2.0:1787367564.883749:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748480 00002000:00100000:2.0:1787367564.883831:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e8fbf59f480 x1874190425748480/t0(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:205/0 lens 504/0 e 0 to 0 dl 1787367575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367564.883846:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbf59f480 with x1874190425748480 ext(0->12) 00002000:00010000:2.0:1787367564.883854:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbf59f480 00000100:00100000:2.0:1787367564.883902:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1787367564.883915:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+11:2357:x1874190425748480:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787367564.885948:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425748480:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 2017us (2401us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787367564.885976:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00002000:00100000:2.0:1787367564.885995:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9e8fbf59f480 x1874190425748480/t4294967320(0) o4->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:205/0 lens 504/448 e 0 to 0 dl 1787367575 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787367564.886008:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbf59f480 with x1874190425748480 ext(0->12) 00002000:00010000:2.0:1787367564.886016:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbf59f480 00000100:00100000:1.0:1787367564.890366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367564.890739:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748608 00000100:00100000:2.0:1787367564.890759:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748608 00000100:00100000:2.0:1787367564.890848:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 227 00000100:00100000:2.0:1787367564.890861:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+66:11625:x1874190425748608:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787367564.931486:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787367564.977855:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787367564.977879:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787367564.978377:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787367564.978428:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787367564.978442:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787367564.978781:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446702848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787367564.978900:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367564.979485:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446702976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787367564.979534:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367564.979710:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446702848 00000100:00100000:0.0:1787367564.979720:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446702848 00000100:00100000:0.0:1787367564.979792:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446702976 00000100:00100000:0.0:1787367564.979795:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446702976 00000100:00100000:0.0:1787367564.979834:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787367564.979846:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446702848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787367564.979888:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787367564.979935:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.979975:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.979987:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787367564.979992:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787367564.979997:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.980290:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.980311:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 12 pid: 6695 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367564.980327:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446703104:192.168.204.23@tcp:104: 00000100:00100000:0.0:1787367564.980435:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92277840 going to sleep for 11 seconds 00000100:00100000:0.0:1787367564.980462:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787367564.980474:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874190446702976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787367564.980794:0:8211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787367564.980799:0:8211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787367565 00002000:00010000:0.0:1787367564.980802:0:8211:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787367564.980804:0:8211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787367565 -> 1787367565 00002000:00010000:0.0:1787367564.980807:0:8211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787367564.981228:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1874190446702976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 753us (1691us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787367564.981238:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1787367564.981557:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb3771500/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787367564.981566:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3771500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446702976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1787367564.982480:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1787367564.982508:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1787367564.982530:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f9a697d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787367564.982535:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbace1800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f9a697c00 00000020:00080000:0.0:1787367564.982538:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbace1200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f857fac00 00000020:00080000:0.0:1787367564.982563:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f850b7c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787367564.982567:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbace1300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f850b7e40 00000100:00100000:3.0:1787367564.982786:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+42:11625:x1874190425748608:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 91923us (92434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367564.982798:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 227 00000020:00080000:2.0:1787367564.983187:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787367564.986853:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbace1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fbf446800 00000004:00080000:0.0:1787367564.987390:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787367564.987483:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787367564.987801:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787367564.987994:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446703232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787367564.988109:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367564.988239:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446703232 00000100:00100000:0.0:1787367564.988996:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446703232 00000100:00100000:0.0:1787367564.989087:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787367564.989100:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874190446703232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787367564.989142:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787367564.989229:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a89108c, atime: 0x6a89108c, ctime: 0x6a89108c, blocks: 0x1 00010000:00010000:0.0:1787367564.989241:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.989424:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1787367564.989431:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367564.989442:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.989466:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.989480:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.989490:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367564.989510:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367564.990338:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367564.990350:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.990363:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598c00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367564.990369:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.990381:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.990419:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.990428:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005d62f3a/0xcbf1f1bac53f462b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367564.990458:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367564.990460:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367564.990462:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367564.990619:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446703232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1519us (2507us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787367564.990632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1787367564.990705:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fbb138a80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787367564.990720:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446703232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787367564.999632:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367564.999686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367564.999941:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748864 00000100:00100000:3.0:1787367564.999955:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748864 00010000:00010000:3.0:1787367565.000024:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 13 pid: 6695 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367565.000082:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:3.0:1787367565.000095:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425748864:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367565.000128:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367565.000135:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 13 pid: 6695 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.000152:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 13 pid: 6695 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.000247:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367565.000254:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787367565.000263:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.000275:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.000301:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367565.000381:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2357:x1874190425748864:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 288us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367565.000390:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:2.0:1787367565.000836:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425748736 00000100:00100000:2.0:1787367565.000844:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425748736 00000100:00100000:2.0:1787367565.000893:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1787367565.000904:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2356:x1874190425748736:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787367565.004576:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041d03fb8/0xcbf1f1bac53f43e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0x55172587972d5cd8 expref: 13 pid: 6695 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.004609:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446703104:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367565.004652:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004666:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004674:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004708:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004717:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004742:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367565.004763:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367565.004770:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004778:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367565.004783:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004793:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004826:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004834:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005560cbc0/0xcbf1f1bac53f4624 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.004856:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367565.004862:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367565.004864:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367565.005630:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3310:x1874190446702848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25783us (26726us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787367565.005644:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1787367565.005717:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb3770a80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787367565.005723:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446702848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787367565.061187:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+12:2356:x1874190425748736:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 60263us (61548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367565.061240:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000001:00080000:0.0:1787367565.065747:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1787367565.065780:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1787367565.065794:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787367565.067313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367565.067431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749120 00000100:00100000:1.0:1787367565.067445:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749120 00000100:00100000:1.0:1787367565.067553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 228 00000100:00100000:1.0:1787367565.067566:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11625:x1874190425749120:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367565.067727:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367565.067768:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f460f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d6b expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.067798:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367565.067805:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367565.067848:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.067867:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.067880:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787367565.068559:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1787367565.068922:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013e220aa reply state 00000000a49c79c0 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.068984:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367565.069167:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:11625:x1874190425749120:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1600us (2212us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787367565.069176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 228 00010000:00010000:1.0:1787367565.075156:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075182:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075258:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075266:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367565.075272:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075281:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075304:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367565.075309:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367565.075315:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.075322:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367565.077330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367565.077501:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749248 00000100:00100000:3.0:1787367565.077516:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749248 00000100:00100000:3.0:1787367565.077670:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1787367565.077683:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f85bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2357:x1874190425749248:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787367565.078005:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787367565.078010:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787367565 -> 1787367564 00002000:00010000:3.0:1787367565.078014:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787367564 00002000:00010000:3.0:1787367565.078017:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787367565 -> 1787367564 00002000:00010000:3.0:1787367565.078019:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787367565.078117:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f85bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2357:x1874190425749248:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 434us (799us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787367565.078127:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:2.0:1787367565.084978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367565.085177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749504 00000100:00100000:1.0:1787367565.085327:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749504 00000100:00100000:1.0:1787367565.085469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:1.0:1787367565.085481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:11625:x1874190425749504:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787367565.085658:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.085681:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.085692:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.085743:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.085760:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 20 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.085777:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3771180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446703360:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367565.085904:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e80300 going to sleep for 11 seconds 00000100:00100000:1.0:1787367565.089721:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3771180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1874190446703360:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367565.089763:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367565.089861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367565.089986:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749632 00000100:00100000:0.0:1787367565.089995:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749632 00010000:00010000:0.0:1787367565.090059:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367565.090112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:0.0:1787367565.090122:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:2357:x1874190425749632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367565.090142:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367565.090150:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090165:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090251:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599600/0xcbf1f1bac53f45f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d5d expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090271:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367565.090294:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090307:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090315:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.090339:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367565.090413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:2357:x1874190425749632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 291us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367565.090423:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00010000:00010000:1.0:1787367565.090496:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090504:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090557:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090578:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090587:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090595:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367565.090600:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090610:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090622:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:1.0:1787367565.090625:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787367565.090630:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.090637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4639 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.090689:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11625:x1874190425749504:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 5210us (5736us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787367565.090699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:0.0:1787367565.095374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367565.095547:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749760 00000100:00100000:1.0:1787367565.095638:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749760 00000100:00100000:1.0:1787367565.095718:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:1.0:1787367565.095757:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2356:x1874190425749760:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787367565.095840:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.095870:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.095881:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367565.095887:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787367565.095892:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.095944:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 8 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.095973:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 8 pid: 8211 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.095992:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446703488:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367565.096518:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e80300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367565.103245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367565.103592:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425749888 00000100:00100000:2.0:1787367565.103605:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425749888 00010000:00010000:2.0:1787367565.103662:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 9 pid: 8211 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367565.103715:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:2.0:1787367565.103727:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425749888:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367565.103769:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367565.103797:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 9 pid: 8211 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.103814:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 9 pid: 8211 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.103862:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367565.103868:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787367565.103875:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.103887:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.103913:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367565.104003:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+9:2356:x1874190425749888:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 277us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367565.104012:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00010000:00010000:1.0:1787367565.104111:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f461d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d79 expref: 8 pid: 8211 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.104129:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3771180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1874190446703488:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367565.104157:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.104179:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.104186:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105255:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105279:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105289:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105297:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367565.105302:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105313:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105333:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.105374:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110003ce/0xcbf1f1bac53f4640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.105514:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425749760:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 9757us (10152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367565.105525:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:0.0:1787367565.112712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367565.112904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425750144 00000100:00100000:3.0:1787367565.112964:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425750144 00000100:00100000:3.0:1787367565.113047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:3.0:1787367565.113060:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11625:x1874190425750144:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787367565.113503:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.113528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.113543:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.114088:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.114331:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.114342:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.114407:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 20 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.114428:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 20 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367565.114448:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446703616:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367565.115427:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367565.119532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367565.119770:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425750272 00000100:00100000:0.0:1787367565.119784:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425750272 00010000:00010000:0.0:1787367565.119857:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367565.119916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:0.0:1787367565.119929:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:2357:x1874190425750272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367565.119950:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367565.119968:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.119986:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 21 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.120058:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:0.0:1787367565.120064:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.120075:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.120083:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367565.120458:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367565.120539:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:2357:x1874190425750272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 610us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367565.120549:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00010000:00010000:2.0:1787367565.121454:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f4601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d64 expref: 20 pid: 6718 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367565.121480:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446703616:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367565.121513:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.121526:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.121532:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367565.123010:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787367565.123379:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787367565.123429:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787367565.123533:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446703744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787367565.123705:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367565.123743:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f84dd8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367565.124086:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446703744 00000100:00100000:1.0:1787367565.124102:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446703744 00000100:00100000:1.0:1787367565.124178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787367565.124189:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874190446703744:12345-0@lo:1000:mdt00_002.0 00000100:00080000:3.0:1787367565.124344:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367565.124468:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874190446703744:12345-0@lo:1000:mdt00_002.0 Request processed in 280us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367565.124477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787367565.124557:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787367565.124563:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787367565.124841:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb3771500, transno 4294967321 00000100:00100000:3.0:1787367565.124861:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9e8fb3770a80 x1874190446702848/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787367580 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367565.124876:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446703744:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787367565.125723:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787367565.126045:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446703872:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787367565.126702:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367565.126745:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367565.126979:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446703872 00000100:00100000:1.0:1787367565.126987:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446703872 00000100:00100000:1.0:1787367565.127047:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367565.127057:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1874190446703872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787367565.127523:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1874190446703872:12345-0@lo:1000:mdt00_002.0 Request processed in 465us (820us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787367565.127532:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367565.127705:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1874190446703872:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787367565.127758:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.127769:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.127790:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.127797:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367565.127802:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.127811:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128073:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f83c18700) 00010000:00010000:3.0:1787367565.128077:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367565.128084:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128092:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74200/0xcbf1f1bac53f464e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128391:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128400:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128406:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128411:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367565.128414:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128435:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128445:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367565.128448:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787367565.128458:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128473:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128485:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.128530:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367565.128546:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446704000:192.168.204.23@tcp:105: 00000100:00100000:3.0:1787367565.128829:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367565.134016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367565.134758:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425750400 00000100:00100000:1.0:1787367565.134773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425750400 00000100:00100000:1.0:1787367565.134873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:1.0:1787367565.134889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11624:x1874190425750400:12345-192.168.204.23@tcp:49:lfs.0 00000100:00100000:1.0:1787367565.135798:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11624:x1874190425750400:12345-192.168.204.23@tcp:49:lfs.0 Request processed in 906us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367565.135833:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1787367565.136008:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1874190446704000:192.168.204.23@tcp:105: 00010000:00010000:3.0:1787367565.136050:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136065:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f800/0xcbf1f1bac53f4591 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136119:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136146:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136161:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136173:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136180:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136187:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136229:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367565.136234:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136242:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136256:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367565.136260:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367565.136263:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136269:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e400/0xcbf1f1bac53f4655 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136280:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136293:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136299:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136305:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367565.136308:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136315:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136323:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367565.136326:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367565.136329:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.136334:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4647 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367565.136710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:11625:x1874190425750144:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 23651us (24012us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787367565.136720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 230 00000020:00080000:3.0:1787367565.136724:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787367565.137048:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787367565.137055:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367565.137832:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787367565.137849:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787367565.141784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367565.141891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367565.142352:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425750912 00000100:00100000:0.0:1787367565.142367:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425750912 00000100:00100000:0.0:1787367565.142451:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:0.0:1787367565.142465:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+23:11624:x1874190425750912:12345-192.168.204.23@tcp:58:lfs.0 00000100:00100000:3.0:1787367565.143479:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425750656 00000100:00100000:3.0:1787367565.143490:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425750656 00000100:00100000:2.0:1787367565.143666:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:2.0:1787367565.143678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+24:11625:x1874190425750656:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787367565.145798:0:6718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787367565.146438:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:11624:x1874190425750912:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 3968us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367565.146452:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 231 00000004:00080000:2.0:1787367565.146696:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787367565.146810:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787367565.148729:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148756:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148770:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148781:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148788:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148794:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367565.148835:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787367565.149109:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:11625:x1874190425750656:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 5419us (7324us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787367565.149140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000020:00080000:2.0:1787367565.149149:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787367565.149600:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367565.149611:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.149621:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367565.149626:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.149637:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.149655:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9e8f8527a400) 00010000:00010000:1.0:1787367565.149659:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787367565.149665:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.149672:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74600/0xcbf1f1bac53f465c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.149694:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367565.149696:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367565.149698:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367565.182465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367565.182746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425751040 00000100:00100000:1.0:1787367565.182760:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425751040 00000100:00100000:1.0:1787367565.183004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:1.0:1787367565.183461:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+25:11627:x1874190425751040:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367565.183494:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367565.183523:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d80 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184080:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184354:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184377:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184386:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.184393:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.185008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.185181:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.185333:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.185398:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.185419:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 26 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367565.185438:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3771500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446704128:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367565.185725:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367565.190448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367565.191247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425751296 00000100:00100000:3.0:1787367565.191262:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425751296 00000100:00100000:3.0:1787367565.191341:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:3.0:1787367565.191371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:5596:x1874190425751296:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787367565.192102:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:5596:x1874190425751296:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 730us (1666us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787367565.192112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:1.0:1787367565.195438:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3771500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1874190446704128:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367565.195484:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367565.195790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367565.196176:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425751424 00000100:00100000:3.0:1787367565.196186:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425751424 00010000:00010000:3.0:1787367565.196329:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 28 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367565.196426:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:3.0:1787367565.196438:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:2356:x1874190425751424:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787367565.196459:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367565.196468:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 28 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196483:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 28 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196512:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ec00/0xcbf1f1bac53f4583 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5d41 expref: 28 pid: 5843 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196533:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:3.0:1787367565.196539:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196550:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196598:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367565.196635:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787367565.196712:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:2356:x1874190425751424:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 275us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367565.196721:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00010000:00010000:1.0:1787367565.196786:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196795:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367565.196861:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787367565.196868:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367565.196892:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196918:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196931:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196948:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196989:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.196996:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367565.197001:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197011:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197032:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:1.0:1787367565.197035:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367565.197040:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197047:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f466a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197060:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197067:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197073:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197079:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367565.197088:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197106:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197115:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9e8f86d97400) 00010000:00010000:1.0:1787367565.197118:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367565.197121:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197127:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197169:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d80 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197183:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d80 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367565.197243:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367565.197247:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787367565.197249:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f800, rc 0) 00000100:00100000:1.0:1787367565.197285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11627:x1874190425751040:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 13829us (14838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367565.197294:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 232 00010000:00010000:2.0:1787367565.955488:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367566.137407:0:12512:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367566.137422:0:12512:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367566.137487:0:12512:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787367566.137495:0:12512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787367566.151648:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367566.151664:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367566.151716:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787367566.151723:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787367566.152078:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446704256:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367566.152540:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f85776a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367566.159254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367566.159479:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425751552 00000100:00100000:1.0:1787367566.159492:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425751552 00000100:00100000:1.0:1787367566.159563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:1.0:1787367566.159575:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:11639:x1874190425751552:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787367566.159639:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787367566.159780:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+27:11639:x1874190425751552:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 207us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367566.159788:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:2.0:1787367566.161834:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1874190446704256:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787367566.165258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367566.166269:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425751808 00000100:00100000:2.0:1787367566.166289:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425751808 00000100:00100000:2.0:1787367566.166377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:2.0:1787367566.166391:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+26:11639:x1874190425751808:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367566.166420:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367566.166453:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f467f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367566.166605:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367566.166627:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367566.166643:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367566.166659:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787367566.166855:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75600/0xcbf1f1bac53f467f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d87 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367566.166897:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d87 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367566.166908:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:2.0:1787367566.166912:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367566.166916:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75c00, rc 0) 00000100:00100000:2.0:1787367566.169234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:11639:x1874190425751808:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 2830us (3967us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787367566.169253:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:0.0:1787367566.176647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367566.176703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367566.176719:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752064 00000100:00100000:1.0:1787367566.176737:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752064 00000100:00100000:0.0:1787367566.176740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752192 00000100:00100000:0.0:1787367566.176750:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752192 00000100:00100000:0.0:1787367566.176844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:1.0:1787367566.176850:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 235 00000100:00100000:0.0:1787367566.176862:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2359:x1874190425752192:12345-192.168.204.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787367566.176875:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:11639:x1874190425752064:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787367566.176978:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.176997:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177009:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177394:0:6718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177403:0:6718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177411:0:6718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177417:0:6718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367566.177421:0:6718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177448:0:6718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177463:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:1.0:1787367566.177466:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787367566.177471:0:6718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367566.177477:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4694 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367566.177637:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+30:11639:x1874190425752064:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 773us (1007us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787367566.177646:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 235 00000040:00080000:3.0:1787367566.178473:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367566.178481:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1787367566.178486:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367566.178527:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75c00/0xcbf1f1bac53f4686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d87 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367566.178558:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367566.178564:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367566.178634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92393450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:2359:x1874190425752192:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1777us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367566.178643:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000040:00080000:3.0:1787367566.178967:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787367566.178978:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367566.186291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367566.186412:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752448 00000100:00100000:3.0:1787367566.186428:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752448 00000100:00100000:3.0:1787367566.186493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:3.0:1787367566.186502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+28:11639:x1874190425752448:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787367566.186760:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:11639:x1874190425752448:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 258us (483us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787367566.186784:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:2.0:1787367566.418690:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446704512:0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.418764:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367566.418771:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446704640:0@lo:400:kworker.0 00000100:00100000:3.0:1787367566.418813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367566.418822:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446705024:0@lo:400:kworker.0 00000100:00100000:3.0:1787367566.418848:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fafdeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446705152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367566.418870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367566.418887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367566.418925:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446704512 00000100:00100000:2.0:1787367566.418945:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446704512 00000100:00100000:3.0:1787367566.418946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446704640 00000100:00100000:3.0:1787367566.418952:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446704640 00000100:00100000:2.0:1787367566.418996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787367566.419007:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446704512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367566.419008:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787367566.419022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446704640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419069:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446704512:12345-0@lo:400:kworker.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367566.419077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446704640:12345-0@lo:400:kworker.0 Request processed in 57us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367566.419081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787367566.419090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787367566.419110:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705024 00000100:00100000:2.0:1787367566.419114:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705024 00000100:00100000:2.0:1787367566.419144:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787367566.419151:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446705024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419186:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874190446705024:12345-0@lo:400:kworker.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367566.419222:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787367566.419223:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446704384:0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419259:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446704512:0@lo:400:kworker.0 00000100:00100000:0.0:1787367566.419259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367566.419269:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446705024:0@lo:400:kworker.0 00000100:00100000:0.0:1787367566.419283:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbae77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446704896:0@lo:400:kworker.0 00000100:00080000:2.0:1787367566.419305:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367566.419305:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787367566.419309:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367566.419319:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705152 00000100:00100000:0.0:1787367566.419321:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367566.419322:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705152 00000100:00100000:0.0:1787367566.419327:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb388ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446704768:0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419346:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787367566.419348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367566.419352:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874190446705152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367566.419374:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446704768 00000100:00100000:0.0:1787367566.419378:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446704768 00002000:00000024:2.0:1787367566.419381:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367566.419404:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787367566.419410:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446704768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419412:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874190446705152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367566.419418:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367566.419433:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446704896 00000100:00100000:2.0:1787367566.419436:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446704896 00000100:00100000:0.0:1787367566.419442:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446704768:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367566.419448:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787367566.419458:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787367566.419463:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446704896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367566.419464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446704384 00000100:00100000:0.0:1787367566.419467:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446704384 00000100:00100000:0.0:1787367566.419488:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787367566.419489:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446704896:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367566.419494:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446704384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419495:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1787367566.419507:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367566.419521:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446704384:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367566.419534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787367566.419535:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446704640:0@lo:400:kworker.0 00000100:00100000:2.0:1787367566.419548:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fafdeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446705152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367566.420322:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb388ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446704768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367566.420333:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446704384:0@lo:400:kworker.0 00000100:00100000:0.0:1787367566.420342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbae77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446704896:0@lo:400:kworker.0 00010000:00010000:1.0:1787367566.981353:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367567.625725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367567.625782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367567.625813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367567.625836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367567.625863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367567.625894:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752576 00000100:00100000:1.0:1787367567.625902:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752576 00000100:00100000:1.0:1787367567.625965:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 296 00000100:00100000:1.0:1787367567.625977:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425752576:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367567.626067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425752576:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367567.626077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 296 00000100:00100000:1.0:1787367567.626129:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752832 00000100:00100000:1.0:1787367567.626134:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752832 00000100:00100000:1.0:1787367567.626173:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752960 00000100:00100000:1.0:1787367567.626176:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752960 00000100:00100000:1.0:1787367567.626233:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1787367567.626242:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425752832:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367567.626287:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3771180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425752832:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 46us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367567.626294:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1787367567.626308:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:1.0:1787367567.626316:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425752960:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367567.626342:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3771880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425752960:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367567.626349:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:1.0:1787367567.626374:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425752704 00000100:00100000:1.0:1787367567.626378:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425752704 00000100:00100000:1.0:1787367567.626411:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:1.0:1787367567.626419:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2359:x1874190425752704:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367567.626457:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3771500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:2359:x1874190425752704:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367567.626464:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:1.0:1787367567.626476:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753088 00000100:00100000:1.0:1787367567.626479:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753088 00000100:00100000:1.0:1787367567.626502:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00100000:1.0:1787367567.626509:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425753088:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367567.626534:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2358:x1874190425753088:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367567.626549:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00080000:1.0:1787367567.626704:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367567.626709:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367567.626711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787367568.003985:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787367568.119883:0:12563:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787367568.119891:0:12563:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787367568.120082:0:12563:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787367568.120090:0:12563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367568.355241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367568.355568:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753344 00000100:00100000:0.0:1787367568.355577:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753344 00000100:00100000:0.0:1787367568.355636:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:0.0:1787367568.355646:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+29:11660:x1874190425753344:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1787367568.355666:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367568.355688:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f469b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d8e expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.355797:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f46a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.355812:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f46a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.355824:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f46a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367568.355836:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787367568.356723:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598600/0xcbf1f1bac53f469b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d8e expref: 32 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.356743:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f46a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d8e expref: 31 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.356751:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367568.356768:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787367568.356773:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599800, rc 0) 00000100:00100000:0.0:1787367568.356843:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11660:x1874190425753344:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1198us (1613us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787367568.356851:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:1.0:1787367568.363435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367568.363569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753472 00000100:00100000:0.0:1787367568.363580:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753472 00000100:00100000:0.0:1787367568.363641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:0.0:1787367568.363653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11660:x1874190425753472:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1787367568.363721:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363738:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363749:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363786:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363793:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363811:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363817:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf598a00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367568.363821:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363828:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363840:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367568.363844:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787367568.363848:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367568.363856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598a00/0xcbf1f1bac53f46b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367568.363959:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+31:11660:x1874190425753472:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 308us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367568.363978:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:1.0:1787367568.450496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367568.450607:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753600 00000100:00100000:2.0:1787367568.450619:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753600 00000100:00100000:2.0:1787367568.450699:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:2.0:1787367568.450711:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425753600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1787367568.450731:0:8211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367568.450765:0:8211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea75eef/0xcbf1f1bac53f46b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d95 expref: -99 pid: 8211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367568.450801:0:8211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a89108c, atime: 0x6a89108c, ctime: 0x6a89108c, blocks: 0xb 00010000:00010000:2.0:1787367568.450824:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787367568.450828:0:8211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367568.450838:0:8211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea75eef/0xcbf1f1bac53f46b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d95 expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367568.450854:0:8211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ea75eef/0xcbf1f1bac53f46b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d95 expref: 8 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367568.450868:0:8211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75e00, rc 0) 00000100:00100000:2.0:1787367568.450937:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2359:x1874190425753600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 229us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367568.450944:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:1.0:1787367568.453223:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367568.453246:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446705280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367568.453315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367568.453456:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705280 00000100:00100000:3.0:1787367568.453465:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705280 00000100:00100000:3.0:1787367568.453532:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787367568.453542:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446705280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367568.453579:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367568.453636:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446705280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367568.453644:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787367568.453690:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446705280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787367568.453882:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367568.455408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367568.455503:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753728 00000100:00100000:1.0:1787367568.455512:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753728 00002000:00100000:1.0:1787367568.455565:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e8fbb13ad80 x1874190425753728/t0(0) o3->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:209/0 lens 488/0 e 0 to 0 dl 1787367579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367568.455577:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbb13ad80 with x1874190425753728 ext(0->4095) 00002000:00010000:1.0:1787367568.455583:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbb13ad80 00000100:00100000:1.0:1787367568.455614:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1787367568.455623:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2358:x1874190425753728:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:1.0:1787367568.456187:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+8:2358:x1874190425753728:12345-192.168.204.23@tcp:3:cat.0 Request processed in 563us (786us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787367568.456233:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00002000:00100000:1.0:1787367568.456241:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9e8fbb13ad80 x1874190425753728/t0(0) o3->1a606c4d-7b95-4897-8da0-e1b28ea5a1c3@192.168.204.23@tcp:209/0 lens 488/4536 e 0 to 0 dl 1787367579 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787367568.456249:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e8fbb13ad80 with x1874190425753728 ext(0->4095) 00002000:00010000:1.0:1787367568.456266:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e8fbb13ad80 00010000:00010000:1.0:1787367569.029386:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787367569.040302:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787367569.040328:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1787367570.043345:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787367570.043360:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787367570.043404:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e8f85776480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787367570.043410:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbf406200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e8f85776180 00000020:00080000:0.0:1787367570.043414:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e8fbf406500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e8fafde3c00 00000020:00080000:0.0:1787367570.043446:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787367570.043652:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787367570.052031:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787367570.560916:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787367570.560936:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:1.0:1787367571.076240:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367571.332474:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367571.332484:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367571.332520:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787367571.332526:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787367571.524387:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446705536:0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.524485:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367571.524548:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446706048:0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.524575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367571.524610:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367571.524616:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446705664:0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.524637:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367571.524665:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705536 00000100:00100000:1.0:1787367571.524671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705536 00000100:00100000:1.0:1787367571.524723:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705664 00000100:00100000:1.0:1787367571.524726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705664 00000100:00100000:1.0:1787367571.524752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787367571.524760:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446705536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.524806:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446705536:12345-0@lo:400:kworker.0 Request processed in 47us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367571.524813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787367571.524828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787367571.524847:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446705664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.524871:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446705664:12345-0@lo:400:kworker.0 Request processed in 25us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367571.524877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787367571.524896:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706048 00000100:00100000:1.0:1787367571.524899:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706048 00000100:00100000:1.0:1787367571.524945:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787367571.524951:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446706048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367571.525219:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446705792:0@lo:400:kworker.0 00000100:00100000:3.0:1787367571.528637:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446706176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367571.528958:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446705408:0@lo:400:kworker.0 00000100:00100000:0.0:1787367571.529603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367571.529706:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705792 00000100:00100000:0.0:1787367571.529714:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705792 00000100:00100000:0.0:1787367571.529770:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787367571.529782:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446705792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367571.529850:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446705792:12345-0@lo:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367571.529857:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787367571.529899:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787367571.529906:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb3770a80, transno 4294967322 00000004:00080000:0.0:1787367571.529917:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787367571.529942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446705792:0@lo:400:kworker.0 00000100:00080000:0.0:1787367571.529997:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367571.530002:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367571.530005:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367571.530046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446705664:0@lo:400:kworker.0 00000100:00100000:0.0:1787367571.530058:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446705536:0@lo:400:kworker.0 00000100:00100000:3.0:1787367571.531763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367571.531848:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706176 00000100:00100000:3.0:1787367571.531856:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706176 00000100:00100000:3.0:1787367571.531896:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787367571.531905:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446706176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367571.531939:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367571.531997:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874190446706176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367571.532004:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787367571.532052:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787367571.532058:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787367571.532079:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fbb138a80, transno 4294967310 00000100:00100000:3.0:1787367571.532098:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446706176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367571.536825:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3772d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446706048:12345-0@lo:400:kworker.0 Request processed in 11863us (12238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367571.536852:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787367571.538425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367571.538486:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446705920:0@lo:400:kworker.0 00000100:00100000:2.0:1787367571.538533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367571.538716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705408 00000100:00100000:1.0:1787367571.538728:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705408 00000100:00100000:1.0:1787367571.538782:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787367571.538792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446705408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.538864:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89d46cbb-4841-4af3-a474-32a0415d3217+19:3313:x1874190446705408:12345-0@lo:400:kworker.0 Request processed in 74us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367571.538871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787367571.538902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446705920 00000100:00100000:1.0:1787367571.538906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446705920 00000100:00100000:1.0:1787367571.538943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787367571.538950:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446705920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367571.538981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446705920:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367571.538987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787367571.539005:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367571.540222:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446705408:0@lo:400:kworker.0 00000100:00100000:2.0:1787367571.540240:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446705920:0@lo:400:kworker.0 00000100:00100000:3.0:1787367571.544328:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3772a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446706048:0@lo:400:kworker.0 00010000:00010000:3.0:1787367572.100441:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367572.747131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367572.747174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367572.747224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367572.747251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367572.747274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367572.747301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754368 00000100:00100000:0.0:1787367572.747322:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754368 00000100:00100000:0.0:1787367572.747382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753984 00000100:00100000:0.0:1787367572.747386:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753984 00000100:00100000:0.0:1787367572.747410:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1787367572.747419:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425754368:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367572.747501:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+5:2359:x1874190425754368:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367572.747510:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1787367572.747530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:0.0:1787367572.747537:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2359:x1874190425753984:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367572.747570:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2359:x1874190425753984:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367572.747576:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:0.0:1787367572.747595:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754112 00000100:00100000:0.0:1787367572.747599:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754112 00000100:00100000:0.0:1787367572.747624:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754240 00000100:00100000:0.0:1787367572.747627:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754240 00000100:00100000:0.0:1787367572.747649:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:0.0:1787367572.747655:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425754112:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367572.747684:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2359:x1874190425754112:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367572.747690:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:0.0:1787367572.747701:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:0.0:1787367572.747708:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425754240:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367572.747735:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2359:x1874190425754240:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367572.747749:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00080000:0.0:1787367572.747766:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787367572.747770:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787367572.747773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367572.747898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425753856 00000100:00100000:1.0:1787367572.747903:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425753856 00000100:00100000:1.0:1787367572.747935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 298 00000100:00100000:1.0:1787367572.747942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425753856:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367572.747968:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425753856:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367572.747974:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 298 00010000:00010000:1.0:1787367573.123517:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367573.571545:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367573.572879:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446706304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367573.573506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367573.573624:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706304 00000100:00100000:1.0:1787367573.573636:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706304 00000100:00100000:1.0:1787367573.573741:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787367573.573754:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446706304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367573.573814:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787367573.573890:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446706304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367573.573899:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787367573.573970:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367573.574505:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446706304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787367574.147520:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367574.621043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367574.621370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754496 00000100:00100000:0.0:1787367574.621385:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754496 00000100:00100000:0.0:1787367574.621485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:0.0:1787367574.621499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11313:x1874190425754496:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1787367574.621703:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367574.621923:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fafdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11313:x1874190425754496:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 Request processed in 427us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367574.621933:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:0.0:1787367574.627637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367574.627731:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754752 00000100:00100000:3.0:1787367574.627743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754752 00000100:00100000:3.0:1787367574.627819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1787367574.627830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:11313:x1874190425754752:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787367574.628480:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:11313:x1874190425754752:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 650us (853us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787367574.628490:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1787367574.904595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367574.904908:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425754880 00000100:00100000:0.0:1787367574.904919:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425754880 00000100:00100000:0.0:1787367574.905066:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 239 00000100:00100000:0.0:1787367574.905077:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:12111:x1874190425754880:12345-192.168.204.23@tcp:101:lsof.0 00010000:00010000:0.0:1787367574.905097:0:6718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367574.905118:0:6718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f46be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5d9c expref: -99 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.905182:0:6718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.906443:0:6718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.906466:0:6718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367574.906730:0:6718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787367574.906734:0:6718:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367574.906830:0:6718:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.906863:0:6718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599200/0xcbf1f1bac53f46be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d9c expref: 7 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.906881:0:6718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d9c expref: 6 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367574.906890:0:6718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367574.906892:0:6718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367574.906896:0:6718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598800, rc 0) 00000100:00100000:0.0:1787367574.906979:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb388ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+6:12111:x1874190425754880:12345-192.168.204.23@tcp:101:lsof.0 Request processed in 1902us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367574.906989:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 239 00000100:00080000:3.0:1787367574.908728:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367575.177754:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787367575.187112:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787367575.187515:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787367575.187527:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787367575.191634:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1787367576.195432:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367576.644407:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446706560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367576.644506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367576.644820:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706560 00000100:00100000:0.0:1787367576.644828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706560 00000100:00100000:0.0:1787367576.644880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787367576.644891:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446706560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367576.644944:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446706560:12345-0@lo:400:kworker.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367576.644958:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787367576.644999:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446706688:0@lo:400:kworker.0 00000100:00100000:0.0:1787367576.645046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367576.645144:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446706560:0@lo:400:kworker.0 00000100:00100000:3.0:1787367576.645153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446707072:0@lo:400:kworker.0 00000100:00100000:3.0:1787367576.645179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367576.645251:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707072 00000100:00100000:3.0:1787367576.645255:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707072 00000100:00100000:3.0:1787367576.645296:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787367576.645303:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446707072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367576.645341:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446707072:12345-0@lo:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367576.645348:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787367576.645364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367576.645389:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446707072:0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645478:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446706816:0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645525:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367576.645568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787367576.645576:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446706432:0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367576.645632:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446706944:0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367576.645684:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706688 00000100:00100000:1.0:1787367576.645688:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706688 00000100:00100000:1.0:1787367576.645717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706944 00000100:00100000:1.0:1787367576.645721:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706944 00000100:00100000:1.0:1787367576.645752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787367576.645759:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446706688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645792:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446706688:12345-0@lo:400:kworker.0 Request processed in 34us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367576.645809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787367576.645823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787367576.645829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446706944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645860:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446706944:12345-0@lo:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367576.645866:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787367576.645887:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706432 00000100:00100000:1.0:1787367576.645890:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706432 00000100:00100000:1.0:1787367576.645914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787367576.645920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446706432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.645947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446706432:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367576.645953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1787367576.645977:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367576.645994:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446706432:0@lo:400:kworker.0 00000100:00100000:1.0:1787367576.646005:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446706944:0@lo:400:kworker.0 00000100:00100000:2.0:1787367576.647285:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446706816 00000100:00100000:2.0:1787367576.647298:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446706816 00000100:00100000:2.0:1787367576.647376:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787367576.647389:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446706816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367576.647506:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446706816:12345-0@lo:400:kworker.0 Request processed in 122us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367576.647513:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787367576.650260:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446706688:0@lo:400:kworker.0 00000100:00100000:0.0:1787367576.650276:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446707200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367576.650351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367576.651333:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707200 00000100:00100000:2.0:1787367576.651345:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707200 00000100:00100000:2.0:1787367576.651419:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787367576.651431:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446707200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787367576.651476:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367576.651544:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446707200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367576.651552:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787367576.651695:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367576.651745:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446706816:0@lo:400:kworker.0 00000100:00100000:0.0:1787367576.651921:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446707200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787367577.219729:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367577.862740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367577.862805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367577.862906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367577.862937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367577.862968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367577.863048:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755008 00000100:00100000:1.0:1787367577.863059:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755008 00000100:00100000:1.0:1787367577.863122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 300 00000100:00100000:1.0:1787367577.863132:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425755008:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367577.863256:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2356:x1874190425755008:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 126us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367577.863271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 300 00000100:00100000:1.0:1787367577.863326:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755264 00000100:00100000:1.0:1787367577.863330:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755264 00000100:00100000:1.0:1787367577.863368:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755392 00000100:00100000:1.0:1787367577.863372:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755392 00000100:00100000:1.0:1787367577.863396:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:1.0:1787367577.863404:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425755264:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367577.863437:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2356:x1874190425755264:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367577.863444:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:1.0:1787367577.863458:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:1.0:1787367577.863465:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425755392:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367577.863491:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2357:x1874190425755392:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 27us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367577.863497:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00080000:1.0:1787367577.863520:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367577.863523:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367577.874449:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755136 00000100:00100000:0.0:1787367577.874467:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755136 00000100:00100000:0.0:1787367577.874584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755520 00000100:00100000:0.0:1787367577.874588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755520 00000100:00100000:0.0:1787367577.874630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:0.0:1787367577.874644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2357:x1874190425755136:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367577.874738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:3.0:1787367577.874750:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2356:x1874190425755520:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367577.874768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2357:x1874190425755136:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 126us (11961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367577.874779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:3.0:1787367577.874786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2356:x1874190425755520:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 38us (11815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367577.874795:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00080000:2.0:1787367577.875143:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367578.246908:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367578.692847:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787367578.692873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f90843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446707328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367578.692972:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367578.693240:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707328 00000100:00100000:3.0:1787367578.693250:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707328 00000100:00100000:3.0:1787367578.693319:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787367578.693329:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446707328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367578.693376:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367578.693439:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446707328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367578.693459:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787367578.693810:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367578.693861:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f90843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446707328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367579.277416:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367579.714782:0:12770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:59:38 (1787367578) 00010000:00010000:3.0:1787367580.291414:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367581.316877:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367581.572463:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787367581.572477:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787367581.573304:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787367581.573314:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787367581.763526:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367581.763561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446707456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367581.763663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367581.763754:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707456 00000100:00100000:0.0:1787367581.763763:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707456 00000100:00100000:0.0:1787367581.763846:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787367581.763858:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446707456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367581.763905:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367581.763961:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446707456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367581.763987:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787367581.764013:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367581.764061:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbf403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446707456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367581.765029:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446707584:0@lo:400:kworker.0 00000100:00100000:0.0:1787367581.765107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367581.765153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446708096:0@lo:400:kworker.0 00000100:00100000:0.0:1787367581.765184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367581.765235:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367581.765242:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446707712:0@lo:400:kworker.0 00000100:00100000:0.0:1787367581.765269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367581.765311:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708096 00000100:00100000:0.0:1787367581.765318:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708096 00000100:00100000:0.0:1787367581.765377:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707712 00000100:00100000:0.0:1787367581.765381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707712 00000100:00100000:0.0:1787367581.765402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787367581.765410:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446708096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367581.765475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874190446708096:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367581.765484:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787367581.765613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707584 00000100:00100000:1.0:1787367581.765618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707584 00000100:00100000:1.0:1787367581.765666:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787367581.765674:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446707584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.765711:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3310:x1874190446707584:12345-0@lo:400:kworker.0 Request processed in 39us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367581.765719:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787367581.765757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787367581.765796:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbf403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446707712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.765830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbf403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446707712:12345-0@lo:400:kworker.0 Request processed in 36us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367581.765837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1787367581.765887:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367581.765900:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446707840:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.765928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367581.765950:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367581.765956:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446707968:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.765985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367581.766016:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707968 00000100:00100000:1.0:1787367581.766020:0:8211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707968 00000100:00100000:1.0:1787367581.766057:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787367581.766064:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446707968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766102:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446707968:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367581.766108:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787367581.766125:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367581.766132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446707840 00000100:00100000:1.0:1787367581.766135:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446707840 00000100:00100000:1.0:1787367581.766158:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787367581.766164:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446707840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446707840:12345-0@lo:400:kworker.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367581.766222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1787367581.766238:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367581.766269:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446707968:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766291:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446707840:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766346:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446707712:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766357:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446707584:0@lo:400:kworker.0 00000100:00100000:1.0:1787367581.766368:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3773480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874190446708096:0@lo:400:kworker.0 00010000:00010000:0.0:1787367582.353046:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367582.979679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367582.979737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367582.979793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367582.979816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367582.979853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367582.979893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425756160 00000100:00100000:3.0:1787367582.979911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425756160 00000100:00100000:3.0:1787367582.979989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755776 00000100:00100000:3.0:1787367582.979992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755776 00000100:00100000:3.0:1787367582.980021:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 177 00000100:00100000:3.0:1787367582.980034:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2358:x1874190425756160:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367582.980131:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f87302e6-9d75-459a-a851-9ecd89807cda+6:2358:x1874190425756160:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 100us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367582.980140:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 177 00000100:00100000:3.0:1787367582.980164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:3.0:1787367582.980171:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2358:x1874190425755776:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367582.980262:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:2358:x1874190425755776:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367582.980269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:3.0:1787367582.980319:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755904 00000100:00100000:3.0:1787367582.980340:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755904 00000100:00100000:3.0:1787367582.980376:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425756032 00000100:00100000:3.0:1787367582.980379:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425756032 00000100:00100000:3.0:1787367582.980402:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:3.0:1787367582.980408:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425755904:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367582.980441:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2358:x1874190425755904:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 33us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367582.980447:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:2.0:1787367582.980457:0:8211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425756032:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367582.980502:0:8211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2358:x1874190425756032:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367582.980938:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:1.0:1787367582.981041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425755648 00000100:00100000:1.0:1787367582.981046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425755648 00000100:00100000:1.0:1787367582.981080:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 302 00000100:00100000:1.0:1787367582.981087:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425755648:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367582.981125:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2358:x1874190425755648:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 39us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367582.981132:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 302 00000100:00080000:1.0:1787367582.981176:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367582.981181:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787367582.981186:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367582.983429:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00010000:00010000:3.0:1787367583.365566:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367583.811553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446708224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367583.811678:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367583.811967:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708224 00000100:00100000:1.0:1787367583.811978:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708224 00000100:00100000:1.0:1787367583.812060:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787367583.812071:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446708224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367583.812116:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787367583.812223:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367583.815091:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3812680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446708224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3007us (3398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367583.815112:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787367583.815499:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446708224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367584.290886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.291235:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425756416 00000100:00100000:1.0:1787367584.291249:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425756416 00000100:00100000:1.0:1787367584.291336:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:1.0:1787367584.291365:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+18:12332:x1874190425756416:12345-192.168.204.23@tcp:35:umount.0 00000100:00080000:2.0:1787367584.292381:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367584.297226:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:12332:x1874190425756416:12345-192.168.204.23@tcp:35:umount.0 Request processed in 5360us (5852us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787367584.297260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:3.0:1787367584.300701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367584.300839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425756672 00000100:00100000:0.0:1787367584.300936:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425756672 00000100:00100000:0.0:1787367584.301061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:0.0:1787367584.301075:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+19:12332:x1874190425756672:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:0.0:1787367584.301679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:12332:x1874190425756672:12345-192.168.204.23@tcp:35:umount.0 Request processed in 604us (989us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787367584.301689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:2.0:1787367584.310404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367584.310630:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425756928 00000100:00100000:0.0:1787367584.310646:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425756928 00000100:00100000:0.0:1787367584.310716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1787367584.310726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f889d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+20:12332:x1874190425756928:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:0.0:1787367584.312614:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f889d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:12332:x1874190425756928:12345-192.168.204.23@tcp:35:umount.0 Request processed in 1716us (3014us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787367584.312632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1787367584.315722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367584.315923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425757184 00000100:00100000:0.0:1787367584.315938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425757184 00000100:00100000:0.0:1787367584.316011:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1787367584.316022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+21:12332:x1874190425757184:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:0.0:1787367584.318717:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:12332:x1874190425757184:12345-192.168.204.23@tcp:35:umount.0 Request processed in 2679us (2993us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787367584.318737:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:1.0:1787367584.328760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.328798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.328827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.328872:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425757312 00000100:00100000:1.0:1787367584.328884:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425757312 00000100:00100000:1.0:1787367584.328954:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425757568 00000100:00100000:1.0:1787367584.328957:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425757568 00000100:00100000:1.0:1787367584.328968:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425757440 00000100:00100000:1.0:1787367584.328971:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425757440 00000100:00100000:1.0:1787367584.328990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1787367584.329001:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+15:2359:x1874190425757312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367584.329021:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367584.329049:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f400/0xcbf1f1bac53f373d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5927 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367584.329072:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367584.329136:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+14:2359:x1874190425757312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367584.329146:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1787367584.329165:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1787367584.329172:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+13:2359:x1874190425757568:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367584.329180:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367584.329210:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f600/0xcbf1f1bac53f3951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59f2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367584.329220:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367584.329258:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:2359:x1874190425757568:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 86us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367584.329267:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:1.0:1787367584.329280:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:1.0:1787367584.329287:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:2359:x1874190425757440:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787367584.329295:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367584.329306:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5ea00/0xcbf1f1bac53f36a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d58ef expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367584.329315:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367584.329329:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2359:x1874190425757440:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 43us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367584.329337:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1787367584.330406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.330775:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425757696 00000100:00100000:1.0:1787367584.330786:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425757696 00000100:00100000:3.0:1787367584.331079:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:3.0:1787367584.331092:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2355:x1874190425757696:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:3.0:1787367584.331127:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3a15 00000100:00080000:3.0:1787367584.331138:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3446000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367584.331223:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787367584.331590:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367584.331620:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367584.336455:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+2:2355:x1874190425757696:12345-192.168.204.23@tcp:9:umount.0 Request processed in 5341us (6031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367584.336476:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:2.0:1787367584.348703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367584.348874:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425758080 00000100:00100000:1.0:1787367584.348889:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425758080 00000100:00100000:1.0:1787367584.348987:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:1.0:1787367584.349000:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+7:2355:x1874190425758080:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:1.0:1787367584.349044:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3c7d 00000020:00010000:1.0:1787367584.349054:0:6696:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e8fbb39f000: total 0 00000100:00080000:1.0:1787367584.349060:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb39e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367584.349117:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787367584.349644:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb38c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+5:2355:x1874190425758080:12345-192.168.204.23@tcp:9:umount.0 Request processed in 645us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367584.349654:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000020:00010000:0.0:1787367584.349886:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e8fbb39f000: total 0 00010000:00010000:0.0:1787367584.349942:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e8fbb39f000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787367584.350020:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775306a8/0xcbf1f1bac53f4019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc7 expref: 4 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.350066:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea75eef/0xcbf1f1bac53f46b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d95 expref: 3 pid: 8211 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.350082:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e8fbb39f000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787367584.350094:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367584.350097:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367584.350099:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367584.350590:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367584.360937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367584.361099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425759104 00000100:00100000:3.0:1787367584.361112:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425759104 00000100:00100000:3.0:1787367584.361240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:3.0:1787367584.361254:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+22:2355:x1874190425759104:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:3.0:1787367584.361313:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f36b1 00000020:00010000:3.0:1787367584.361340:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e8fbb1a6000: total 0 00000100:00080000:3.0:1787367584.361347:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367584.361394:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787367584.362064:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e8fbb1a6000: total 0 00010000:00010000:0.0:1787367584.362129:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e8fbb1a6000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787367584.362178:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:0.0:1787367584.362182:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367584.362211:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74a00/0xcbf1f1bac53f407b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5be3 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.362235:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97000) 00010000:00010000:0.0:1787367584.362237:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367584.362242:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e200/0xcbf1f1bac53f3997 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a07 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.363974:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367584.363987:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787367584.364003:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599800/0xcbf1f1bac53f46a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d8e expref: 19 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364061:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367584.364064:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367584.364069:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74400/0xcbf1f1bac53f3fda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bb2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364082:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367584.364084:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787367584.364087:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5ec00/0xcbf1f1bac53f4004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bc0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364099:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367584.364102:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787367584.364106:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d80 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364118:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367584.364121:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367584.364126:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5cbc expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364141:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:0.0:1787367584.364143:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787367584.364148:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e800/0xcbf1f1bac53f3cd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5aee expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364159:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18200) 00010000:00010000:0.0:1787367584.364162:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367584.364273:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598400/0xcbf1f1bac53f397b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a00 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367584.364285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a606c4d-7b95-4897-8da0-e1b28ea5a1c3+13:2355:x1874190425759104:12345-192.168.204.23@tcp:39:umount.0 Request processed in 3020us (3347us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787367584.364304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 240 00010000:00010000:0.0:1787367584.364311:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9e8f83c18500) 00010000:00010000:0.0:1787367584.364316:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367584.364326:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f3efa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5b7a expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364356:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9e8f890a8600) 00010000:00010000:0.0:1787367584.364359:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787367584.364365:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a75800/0xcbf1f1bac53f39eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5a1c expref: 10 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364384:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9e8f829e0400) 00010000:00010000:0.0:1787367584.364387:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787367584.364392:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d48 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364434:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9e8f890a8c00) 00010000:00010000:0.0:1787367584.364438:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787367584.364442:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb2a74800/0xcbf1f1bac53f4097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5bea expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367584.364455:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e8fbb1a6000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787367584.364492:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367584.364494:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367584.364496:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367584.388394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367585.412304:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787367585.417231:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787367585.417272:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000001:00080000:1.0:1787367585.417280:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787367585.417283:0:5864:0:(genops.c:885:class_export_put()) final put ffff9e8fbb1a6000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:2.0:1787367585.417383:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbb1a6000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-MDT0000 00000020:00000080:2.0:1787367585.417461:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbb1a3800 for lustre-MDT0000 00000001:00100000:1.0:1787367585.905731:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:1.0:1787367585.905740:0:6722:0:(genops.c:885:class_export_put()) final put ffff9e8fbb39f000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:3.0:1787367585.905863:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbb39f000/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-OST0000 00000020:00000080:3.0:1787367585.905926:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbb39e800 for lustre-OST0000 00010000:00010000:0.0:1787367586.435428:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367586.470911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367586.470954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367586.470989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367586.471153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425759232 00000100:00100000:2.0:1787367586.471165:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425759232 00000100:00100000:2.0:1787367586.471254:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425759488 00000100:00100000:2.0:1787367586.471258:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425759488 00000100:00100000:2.0:1787367586.471273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425759360 00000100:00100000:2.0:1787367586.471276:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425759360 00000100:00100000:2.0:1787367586.471293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1787367586.471302:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+12:2358:x1874190425759232:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367586.471320:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367586.471339:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496000/0xcbf1f1bac53f3783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d593c expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367586.471358:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367586.471406:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+11:2358:x1874190425759232:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 105us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367586.471412:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1787367586.471428:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:2.0:1787367586.471433:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+10:2358:x1874190425759488:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367586.471440:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367586.471449:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e800/0xcbf1f1bac53f394a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d59eb expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367586.471458:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367586.471473:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+9:2358:x1874190425759488:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 40us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367586.471494:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:2.0:1787367586.471506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:2.0:1787367586.471512:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+8:2358:x1874190425759360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367586.471519:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367586.471527:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2174600/0xcbf1f1bac53f378a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5966 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367586.471536:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367586.471563:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+7:2358:x1874190425759360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 51us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367586.471569:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:3.0:1787367586.481970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367586.482126:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425759744 00000100:00100000:1.0:1787367586.482137:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425759744 00000100:00100000:1.0:1787367586.482236:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 241 00000100:00100000:1.0:1787367586.482246:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+6:2355:x1874190425759744:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:1.0:1787367586.482286:0:6718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3798 00000020:00010000:1.0:1787367586.482295:0:6718:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e8fbf487800: total 0 00000100:00080000:1.0:1787367586.482299:0:6718:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf482000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787367586.482325:0:6718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787367586.482763:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbaefc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f87302e6-9d75-459a-a851-9ecd89807cda+5:2355:x1874190425759744:12345-192.168.204.23@tcp:39:umount.0 Request processed in 517us (801us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787367586.482771:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 241 00000100:00080000:2.0:1787367586.483029:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787367586.493636:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e8fbf487800: total 0 00010000:00010000:3.0:1787367586.493650:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367586.494993:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e8fbf487800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787367586.495045:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f890a8200) 00010000:00010000:3.0:1787367586.495050:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367586.495062:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f46c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5d9c expref: 4 pid: 6718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367586.495089:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e8fbf487800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787367586.495102:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367586.495104:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367586.495106:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367586.511757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367586.511903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760000 00000100:00100000:2.0:1787367586.511913:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760000 00000100:00100000:2.0:1787367586.511980:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 303 00000100:00100000:2.0:1787367586.511991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+7:2355:x1874190425760000:12345-192.168.204.23@tcp:251:umount.0 00000020:00000080:2.0:1787367586.512042:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f368e 00000020:00010000:2.0:1787367586.512051:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e8f91dbb000: total 0 00000100:00080000:2.0:1787367586.512055:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9e8f91dba000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787367586.512132:0:7632:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e8f91dbb000: total 0 00000100:00100000:2.0:1787367586.512135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7+3:2355:x1874190425760000:12345-192.168.204.23@tcp:251:umount.0 Request processed in 146us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367586.512143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 303 00010000:00010000:0.0:1787367586.512174:0:7632:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e8f91dbb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787367586.512230:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357fa00/0xcbf1f1bac53f3744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d592e expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367586.512245:0:7632:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e8f91dbb000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787367586.512255:0:7632:0:(genops.c:885:class_export_put()) final put ffff9e8f91dbb000/1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7 00010000:00010000:0.0:1787367586.512269:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367586.512272:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367586.512273:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787367586.512278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91dbb000/1ff8ab0b-f669-4ade-a129-5b63fa8d8ff7 for MGS 00000020:00000080:2.0:1787367586.512317:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8f91dba000 for MGS 00000100:00100000:1.0:1787367586.883489:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446708736:0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.883504:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446708608:0@lo:400:kworker.0 00000100:00100000:0.0:1787367586.883596:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446708864:0@lo:400:kworker.0 00000100:00100000:2.0:1787367586.883644:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446708352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367586.888449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367586.888584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446709120:0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.888632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367586.891019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708608 00000100:00100000:3.0:1787367586.891037:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708608 00000100:00100000:3.0:1787367586.891130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787367586.891141:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446708608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.891284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446708608:12345-0@lo:400:kworker.0 Request processed in 145us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367586.891291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787367586.891350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446708608:0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.891449:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709120 00000100:00100000:3.0:1787367586.891453:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709120 00000100:00100000:3.0:1787367586.891495:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367586.891501:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446709120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.891551:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446709120:12345-0@lo:400:kworker.0 Request processed in 50us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367586.891558:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787367586.891584:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446709120:0@lo:400:kworker.0 00000100:00080000:3.0:1787367586.891616:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367586.892691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367586.894799:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708736 00000100:00100000:3.0:1787367586.894820:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708736 00000100:00100000:3.0:1787367586.895073:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787367586.895086:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446708736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.895245:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446708736:12345-0@lo:400:kworker.0 Request processed in 162us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367586.895253:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1787367586.896112:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367586.896178:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446708736:0@lo:400:kworker.0 00000100:00100000:0.0:1787367586.897227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367586.897385:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708864 00000100:00100000:3.0:1787367586.897395:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708864 00000100:00100000:3.0:1787367586.897468:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787367586.897480:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446708864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367586.897569:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446708864:12345-0@lo:400:kworker.0 Request processed in 91us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367586.897577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787367586.897753:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367586.897787:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446708864:0@lo:400:kworker.0 00000100:00100000:2.0:1787367586.899225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367586.899373:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446708480:0@lo:400:kworker.0 00000100:00100000:2.0:1787367586.899427:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367586.899456:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446708992:0@lo:400:kworker.0 00000100:00100000:2.0:1787367586.899483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367586.899513:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708992 00000100:00100000:2.0:1787367586.899521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708992 00000100:00100000:2.0:1787367586.900289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787367586.900302:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446708992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367586.900444:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446708992:12345-0@lo:400:kworker.0 Request processed in 89us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367586.900451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1787367586.900479:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367586.900524:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446708992:0@lo:400:kworker.0 00000100:00100000:1.0:1787367586.901810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708480 00000100:00100000:1.0:1787367586.901823:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708480 00000100:00100000:1.0:1787367586.901908:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787367586.901919:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446708480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367586.902030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89d46cbb-4841-4af3-a474-32a0415d3217+19:3312:x1874190446708480:12345-0@lo:400:kworker.0 Request processed in 115us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367586.902037:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787367586.902117:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446708480:0@lo:400:kworker.0 00000100:00100000:0.0:1787367586.910591:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446708352 00000100:00100000:0.0:1787367586.910616:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446708352 00000100:00100000:0.0:1787367586.910710:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787367586.910723:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446708352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367586.910786:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367586.910923:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3903480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446708352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (11708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367586.910931:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787367586.911099:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446708352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787367587.461390:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787367588.266695:0:12971:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787367588.286374:0:12971:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787367588.286438:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286465:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286472:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286479:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286498:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787367588.286513:0:12971:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787367588.286538:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367588.286544:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286551:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ee00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367588.286555:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286563:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367588.286570:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367588.286576:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367588.286579:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787367588.286582:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787367588.286620:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286632:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367588.286889:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286897:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f3713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f371a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.286910:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.286911:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.286913:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787367588.286929:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787367588.286934:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787367588.286949:0:12971:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787367588.286963:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8f85be3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787367588.287005:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446709376:0@lo:39:umount.0 00000100:00100000:3.0:1787367588.287073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367588.287147:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709376 00000100:00100000:3.0:1787367588.287155:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709376 00000100:00100000:3.0:1787367588.287224:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787367588.287234:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874190446709376:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787367588.287263:0:6718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f349d 00000100:00080000:3.0:1787367588.287273:0:6718:0:(import.c:65:import_set_state_nolock()) ffff9e8f90245000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787367588.287338:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874190446709376:12345-0@lo:39:umount.0 Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367588.287345:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787367588.287354:0:6718:0:(genops.c:885:class_export_put()) final put ffff9e8f90241000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787367588.287393:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8f85be3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787367588.287408:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446709376:0@lo:39:umount.0 00000100:00080000:3.0:1787367588.287427:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787367588.287429:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787367588.287432:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787367588.288439:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367588.288466:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446709248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367588.288533:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787367588.288581:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787367588.288592:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f90241000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787367588.288640:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8f90245000 for lustre-MDT0000 00000100:00100000:2.0:1787367588.288833:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709248 00000100:00100000:2.0:1787367588.288841:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709248 00000100:00100000:2.0:1787367588.288892:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367588.288901:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+19:3311:x1874190446709248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367588.288915:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367588.288931:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fc2174c00/0xcbf1f1bac53f371a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f3713 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367588.288947:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367588.288985:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92392450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+18:3311:x1874190446709248:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367588.288992:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787367588.289088:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446709248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367588.293831:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293855:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293862:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293868:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293891:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367588.293905:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367588.293912:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293919:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497800 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367588.293924:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.293933:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367588.293940:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367588.293961:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367588.293964:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787367588.294001:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294009:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367588.294030:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294037:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81497800/0xcbf1f1bac53f3721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3728 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294052:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.294054:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.294056:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.294068:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294075:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294082:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294087:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294099:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367588.294108:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367588.294118:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294124:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367588.294127:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294134:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367588.294140:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367588.294145:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367588.294147:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787367588.294149:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787367588.294166:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294172:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367588.294187:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294214:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f81497e00/0xcbf1f1bac53f3648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f364f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.294229:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.294230:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367588.294239:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787367588.294258:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446709632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367588.294340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367588.294396:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709632 00000100:00100000:3.0:1787367588.294403:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709632 00000100:00100000:3.0:1787367588.294451:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787367588.294460:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+18:3313:x1874190446709632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367588.294476:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367588.294491:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030800/0xcbf1f1bac53f364f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f3648 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.294527:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367588.295959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446709504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787367588.296016:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367588.296079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709504 00000100:00100000:2.0:1787367588.296085:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709504 00000100:00100000:2.0:1787367588.296135:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367588.296143:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+18:3311:x1874190446709504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367588.296156:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367588.296172:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f3728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f3721 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367588.296186:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367588.296242:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89d46cbb-4841-4af3-a474-32a0415d3217+17:3311:x1874190446709504:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367588.296249:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367588.296290:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446709504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367588.297097:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297111:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297118:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297125:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297151:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367588.297159:0:12971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297167:0:12971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297181:0:12971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297187:0:12971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367588.297235:0:12971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787367588.297240:0:12971:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787367588.297245:0:12971:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787367588.297276:0:12971:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787367588.297281:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787367588.297285:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367588.297290:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787367588.297296:0:12971:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e8fb3364000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367588.297302:0:12971:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e8fbfa03800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367588.297309:0:12971:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e8fbf487800 f87302e6-9d75-459a-a851-9ecd89807cda 192.168.204.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367588.297313:0:12971:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e8fa00fb370) has exports, disconnecting them 00000020:00080000:1.0:1787367588.297318:0:12971:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e8fb3364000), last request at 1787367586 00000020:00000080:1.0:1787367588.297325:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3610 00000100:00080000:1.0:1787367588.297340:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3360000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787367588.297359:0:12971:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8fb3364000): rc 0 00000020:00000080:1.0:1787367588.297362:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3364000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787367588.297372:0:12971:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e8fbfa03800), last request at 1787367586 00000020:00000080:1.0:1787367588.297375:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3545 00000100:00080000:1.0:1787367588.297380:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8fbfa04800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787367588.297392:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3364000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787367588.297433:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fb3360000 for lustre-MDT0000 00000020:00080000:1.0:1787367588.297459:0:12971:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8fbfa03800): rc 0 00000020:00000080:1.0:1787367588.297461:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fbfa03800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787367588.297471:0:12971:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4e140dabae0 00000020:00000080:1.0:1787367588.297481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbfa03800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787367588.297518:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbfa04800 for lustre-MDT0000 00000100:00080000:1.0:1787367588.297545:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787367588.297549:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787367588.297561:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787367588.297620:0:12971:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787367588.297639:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf5fb800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787367588.297861:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89d46cbb-4841-4af3-a474-32a0415d3217+16:3313:x1874190446709632:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367588.297871:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787367588.297902:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367588.297908:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.297915:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599400 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367588.297919:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.297927:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367588.297935:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367588.297940:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787367588.297943:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787367588.297951:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787367588.297974:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.297981:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367588.297996:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298003:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599400/0xcbf1f1bac53f393c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3943 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298014:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367588.298017:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298023:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f80031000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367588.298025:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298031:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367588.298038:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367588.298043:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367588.298044:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787367588.298046:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787367588.298058:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298063:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367588.298089:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367588.298096:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f80031000/0xcbf1f1bac53f33fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3403 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367588.298271:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367588.298279:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367588.298292:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446709888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787367588.298348:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367588.298390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367588.298397:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446710016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787367588.298421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367588.298446:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709888 00000100:00100000:2.0:1787367588.298451:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709888 00000100:00100000:2.0:1787367588.298490:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710016 00000100:00100000:2.0:1787367588.298493:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710016 00000100:00100000:2.0:1787367588.298537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787367588.298545:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+17:3312:x1874190446709888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367588.298555:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367588.298570:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f3943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f393c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367588.298581:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367588.298611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3773100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+16:3312:x1874190446709888:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367588.298617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787367588.298630:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787367588.298636:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+15:3311:x1874190446710016:12345-0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787367588.298736:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787367588.298740:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787367588.298749:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787367588.298824:0:12971:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787367588.298837:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3364800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787367588.298865:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e8fa00fb370) has no exports 00010000:00010000:3.0:1787367588.298928:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.298931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367588.298933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367588.298946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446709760:0@lo:9:umount.0 00000100:00100000:3.0:1787367588.298982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367588.299002:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446710144:0@lo:9:umount.0 00000100:00100000:3.0:1787367588.299022:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367588.299049:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446709760 00000100:00100000:3.0:1787367588.299053:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446709760 00000100:00100000:3.0:1787367588.299087:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710144 00000100:00100000:3.0:1787367588.299091:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710144 00000100:00100000:3.0:1787367588.299110:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367588.299117:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874190446709760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787367588.299141:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f35a0 00000100:00080000:3.0:1787367588.299149:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8fbfa03000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787367588.299445:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367588.299458:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f3403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f33fc expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367588.299471:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367588.299523:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3770e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89d46cbb-4841-4af3-a474-32a0415d3217+14:3311:x1874190446710016:12345-0@lo:103:ldlm_bl.0 Request processed in 887us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367588.299530:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787367588.299742:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446710016:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787367588.299954:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787367588.299958:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367588.299963:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367588.299980:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446709888:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787367588.300088:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787367588.301128:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1874190446709760:12345-0@lo:9:umount.0 Request processed in 2008us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367588.301138:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367588.301159:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787367588.301160:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fbf5fb800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787367588.301169:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874190446710144:12345-0@lo:9:umount.0 00000004:00080000:0.0:1787367588.301182:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787367588.301185:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367588.301188:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446709760:0@lo:9:umount.0 00000020:00000080:3.0:1787367588.301207:0:6695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3679 00000100:00080000:3.0:1787367588.301226:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9e8f91db9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787367588.301263:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1787367588.301328:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367588.301383:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3309:x1874190446710144:12345-0@lo:9:umount.0 Request processed in 216us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367588.301389:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787367588.301406:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3364800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1787367588.301416:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787367588.301416:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787367588.301417:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367588.301420:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446710144:0@lo:9:umount.0 00000100:00100000:3.0:1787367588.301435:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446709632:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787367588.314931:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e8fa00fb370) has no exports 00000020:00000080:1.0:1787367588.404569:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3457 00000020:00000080:1.0:1787367588.404588:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fbc0f5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787367588.404612:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787367588.405335:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367588.405347:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787367588.405352:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e8fbc0e19b8) has no exports 00000020:00000080:0.0:1787367588.405657:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbc0f5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787367588.409113:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3450 00000020:00000080:3.0:1787367588.409130:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787367588.409221:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367588.409233:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787367588.409236:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3c97000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787367588.409239:0:12971:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3c97000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787367588.409250:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787367588.409450:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787367588.483471:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367589.515885:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787367589.516276:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367589.516285:0:7644:0:(genops.c:885:class_export_put()) final put ffff9e8f91dbc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787367589.516313:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:1.0:1787367589.516316:0:7644:0:(genops.c:885:class_export_put()) final put ffff9e8fb3440800/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 00000020:00000080:0.0:1787367589.516366:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91dbc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787367589.516544:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3440800/1a606c4d-7b95-4897-8da0-e1b28ea5a1c3 for lustre-OST0001 00000020:00000080:0.0:1787367589.516573:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8f91db9800 for lustre-OST0001 00000020:00000080:0.0:1787367589.516578:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fb3446000 for lustre-OST0001 00000001:00100000:2.0:1787367590.520511:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f87302e6-9d75-459a-a851-9ecd89807cda 00000001:00080000:2.0:1787367590.520531:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787367590.520536:0:5864:0:(genops.c:885:class_export_put()) final put ffff9e8fbf487800/f87302e6-9d75-459a-a851-9ecd89807cda 00000020:00000080:0.0:1787367590.520948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf487800/f87302e6-9d75-459a-a851-9ecd89807cda for lustre-MDT0000 00000020:00000080:0.0:1787367590.521019:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbf482000 for lustre-MDT0000 00010000:00010000:3.0:1787367590.531480:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787367591.056377:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367591.056385:0:6722:0:(genops.c:885:class_export_put()) final put ffff9e8fbfa04000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787367591.056486:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbfa04000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787367591.056709:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbfa03000 for lustre-OST0000 00010000:00010000:2.0:1787367591.556301:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367592.003592:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367592.003616:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446710272:0@lo:400:kworker.0 00000100:00100000:2.0:1787367592.003616:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446710528:0@lo:400:kworker.0 00000100:00100000:0.0:1787367592.003751:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446710400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367592.005740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367592.007003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367592.007168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367592.007764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710272 00000100:00100000:2.0:1787367592.007774:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710272 00000100:00100000:2.0:1787367592.007826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787367592.007836:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:3310:x1874190446710272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367592.007902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89d46cbb-4841-4af3-a474-32a0415d3217+14:3310:x1874190446710272:12345-0@lo:400:kworker.0 Request processed in 68us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367592.007909:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787367592.007957:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446710272:0@lo:400:kworker.0 00000100:00100000:1.0:1787367592.014182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710528 00000100:00100000:1.0:1787367592.014209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710528 00000100:00100000:1.0:1787367592.014273:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710400 00000100:00100000:1.0:1787367592.014276:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710400 00000100:00100000:1.0:1787367592.014350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787367592.014359:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874190446710528:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367592.014369:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367592.014470:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874190446710528:12345-0@lo:400:kworker.0 Request processed in 110us (8737us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367592.014477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787367592.014493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787367592.014497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874190446710400:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787367592.014502:0:5841:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787367592.014633:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1874190446710400:12345-0@lo:400:kworker.0 Request processed in 29us (7361us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787367592.014642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787367592.014886:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787367592.014892:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787367592.014896:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787367592.019177:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787367592.019184:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787367592.019189:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787367592.019209:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367592.019213:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 201 00000100:00080000:1.0:1787367592.019221:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e8fb3363000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367592.019256:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fa014ed80 x1874190446710656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367592.019283:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446710528:0@lo:400:kworker.0 00000100:00100000:3.0:1787367592.019715:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446710656:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787367592.019784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367592.020628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710656 00000100:00100000:1.0:1787367592.020637:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710656 00000100:00100000:1.0:1787367592.020684:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787367592.020691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874190446710656:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787367592.020707:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787367592.039567:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787367592.039914:0:3312:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 183 00000100:00080000:0.0:1787367592.039925:0:3312:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e8fafac1800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1787367592.039970:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fbb1ca300 x1874190446710784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367592.040019:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446710400:0@lo:400:kworker.0 00000100:00100000:3.0:1787367592.042748:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446710784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787367592.042829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367592.042965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446710784 00000100:00100000:3.0:1787367592.042972:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446710784 00000100:00100000:3.0:1787367592.043043:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787367592.043050:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1874190446710784:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787367592.043067:0:6718:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787367592.043113:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1874190446710784:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 61us (283us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367592.043120:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787367592.043160:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367592.043165:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787367592.043169:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446710784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787367592.056824:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1874190446710656:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36121us (37028us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367592.056842:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787367592.057736:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367592.057747:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787367592.057753:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446710656:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787367592.579566:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367593.605828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787367594.499742:0:12971:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f91692420 - data ffff9e8f873aeaf8/ffff9e8fbb28b000 00000020:01000000:1.0:1787367594.499908:0:12971:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f86faa000 - data ffff9e8f87055510/ffff9e8fa01e0800 00000001:00000004:1.0:1787367594.509671:0:12971:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1787367594.630637:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367594.653585:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787367594.653596:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787367594.653619:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367594.653622:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787367594.654137:0:7002:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787367594.654144:0:7002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787367594.654154:0:7002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787367594.655327:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787367594.655334:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787367594.655350:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367594.655352:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787367594.656801:0:7932:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787367594.656807:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1787367594.656817:0:7932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787367594.747894:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f341f 00000020:00000080:0.0:1787367594.747910:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787367594.749056:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3434 00000020:00000080:0.0:1787367594.749067:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3c96000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787367594.749074:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787367594.749079:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.749089:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787367594.749093:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e8fa00f8000) has no exports 00000004:01000000:0.0:1787367594.749277:0:12971:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787367594.749285:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3672 00000020:00000080:0.0:1787367594.749289:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8e81d4f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787367594.749292:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787367594.749295:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.749301:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787367594.749304:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9e8fb353b370) has no exports 00000020:00000080:0.0:1787367594.749309:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f366b 00000020:00000080:0.0:1787367594.749319:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3361800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787367594.749648:0:12971:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787367594.749652:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787367594.749657:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787367594.749662:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367594.749665:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367594.749697:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.749703:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367594.749707:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f358b 00000020:00000080:0.0:1787367594.749711:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fbfa05000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787367594.749714:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787367594.749718:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.749720:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787367594.749722:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e8fafcecd28) has no exports 00000020:00000080:0.0:1787367594.749726:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3584 00000020:00000080:0.0:1787367594.749728:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fbf5fc800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787367594.750046:0:12971:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787367594.750049:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787367594.750051:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787367594.750054:0:12971:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787367594.750055:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367594.750081:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.750085:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367594.750108:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.750110:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787367594.750135:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f343b 00000020:00000080:0.0:1787367594.750140:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3c90800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787367594.750143:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787367594.750146:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.750148:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787367594.750151:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e8fa00f99b8) has no exports 00000020:00000080:0.0:1787367594.750171:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.750178:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787367594.750181:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3442 00000020:00000080:0.0:1787367594.750184:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fb3c93800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787367594.750212:0:12971:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8f92200800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787367594.750215:0:12971:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8f92200800 3 00000020:01000004:0.0:1787367594.750218:0:12971:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e8f92200800 from lustre-MDT0000 00000020:00000080:0.0:1787367594.750235:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.750238:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787367594.750240:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa3800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787367594.750243:0:12971:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787367594.750251:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787367594.750315:0:12971:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787367594.750318:0:12971:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787367594.750320:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787367594.750323:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.750325:0:12971:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787367594.750331:0:12971:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e8fa602f800 89d46cbb-4841-4af3-a474-32a0415d3217 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787367594.750336:0:12971:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e8fa00fcd28) has exports, disconnecting them 00000020:00080000:0.0:1787367594.750340:0:12971:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e8fa602f800), last request at 1787367359 00000020:00000080:0.0:1787367594.750353:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f33e0 00000020:00010000:0.0:1787367594.750356:0:12971:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e8fa602f800: total 8 00000100:00080000:0.0:1787367594.750360:0:12971:0:(import.c:65:import_set_state_nolock()) ffff9e8fa602e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787367594.750389:0:12971:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8fa602f800): rc 0 00000020:00080000:0.0:1787367594.750393:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e8fa00fcd28) has no exports 00000020:00010000:2.0:1787367594.750942:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e8fa602f800: total 8 00010000:00010000:2.0:1787367594.750978:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e8fa602f800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787367594.751007:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb2a74c00/0xcbf1f1bac53f3927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f3920 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751025:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496400/0xcbf1f1bac53f370c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f3705 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751038:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f80030a00/0xcbf1f1bac53f34f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f34f1 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751050:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357ee00/0xcbf1f1bac53f3736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f372f expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751068:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5f400/0xcbf1f1bac53f3935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f392e expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751080:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e600/0xcbf1f1bac53f36e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f36db expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751090:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f36f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f36e9 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751099:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357fe00/0xcbf1f1bac53f36fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcbf1f1bac53f36f7 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367594.751108:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e8fa602f800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787367594.751118:0:5830:0:(genops.c:885:class_export_put()) final put ffff9e8fa602f800/89d46cbb-4841-4af3-a474-32a0415d3217 00010000:00010000:2.0:1787367594.751124:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367594.751126:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367594.751128:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367594.751159:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e8f90463600:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1787367594.751264:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e8f90462400:5835] 1 exiting: rc = 0 00000020:00000080:1.0:1787367594.751392:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367594.751407:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3c96000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787367594.751412:0:37:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367594.751414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787367594.751418:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367594.751535:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8e81d4f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787367594.751541:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3361800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367594.751545:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fb3364800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787367594.751549:0:37:0:(genops.c:885:class_export_put()) final put ffff9e8fb3366000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367594.751551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3366000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787367594.751554:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367594.751578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbfa05000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787367594.751583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf5fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367594.751587:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fbf5fb800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787367594.751590:0:37:0:(genops.c:885:class_export_put()) final put ffff9e8fbfa00000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787367594.751592:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbfa00000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787367594.751599:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787367594.751664:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3c90800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787367594.751669:0:37:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa7800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787367594.751671:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787367594.751674:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787367594.751816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3c93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787367594.751820:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fa602f800/89d46cbb-4841-4af3-a474-32a0415d3217 for MGS 00000020:00000080:1.0:1787367594.751862:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fa602e000 for MGS 00000100:00100000:2.0:1787367594.752331:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e8f90463200:5836] 2 exiting: rc = 0 00000100:00100000:0.0:1787367594.756307:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756340:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756347:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756353:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756372:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756388:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756394:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756400:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756425:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756432:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756437:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756443:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756448:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756455:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756461:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756467:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756477:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756482:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756488:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756495:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756501:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756507:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756513:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756519:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756525:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756530:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756535:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756540:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756545:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756550:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756556:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756561:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756567:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756573:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756579:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756584:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756589:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756595:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756600:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756605:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756612:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756617:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756623:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756638:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756643:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756649:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756656:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756662:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756667:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756673:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756678:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756684:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756688:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756694:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756698:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756703:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756709:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756715:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756721:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756727:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756732:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756738:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756743:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.756748:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787367594.757152:0:12971:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787367594.757157:0:12971:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787367594.764107:0:12971:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8e831a32a0 - data ffff9e8fbfdfc000/ffff9e8fb32fd400 00000020:01000000:0.0:1787367594.764266:0:12971:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f83a39ba0 - data ffff9e8f9fb80870/ffff9e8fa0121c00 00000020:00000080:0.0:1787367594.765611:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f33c4 00000020:00000080:0.0:1787367594.765620:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8f91cab800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787367594.765641:0:12971:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8f92200800 from MGS, refs=2 00000020:01000004:0.0:1787367594.765644:0:12971:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8f92200800 2 00000020:01000004:0.0:1787367594.765647:0:12971:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e8f92200800 from MGS 00000020:00000080:0.0:1787367594.765673:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.765680:0:12971:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787367594.765683:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8f91cab000/MGS 00000020:00000080:0.0:1787367594.765686:0:12971:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91cab000/MGS for MGS 00000020:01000000:0.0:1787367594.765693:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787367594.765781:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787367594.765785:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367594.765790:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787367594.765798:0:12971:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e8fafac5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787367594.765804:0:12971:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9e8fb35399b8) has exports, disconnecting them 00000020:00080000:0.0:1787367594.765808:0:12971:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e8fafac5000), last request at 1787367360 00000020:00000080:0.0:1787367594.765813:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f348f 00000020:00080000:0.0:1787367594.765889:0:12971:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8fafac5000): rc 0 00000020:00000080:0.0:1787367594.765895:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8fafac5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787367594.766284:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91cab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787367594.766292:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafac5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787367594.768488:0:12971:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787367594.768497:0:12971:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367594.768501:0:12971:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787367594.768508:0:12971:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787367594.768693:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367594.768701:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787367594.768709:0:12971:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8f92200800 1 00000020:00000080:1.0:1787367594.768717:0:12971:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f33b6 00000020:00000080:1.0:1787367594.768726:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8f91ca8000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787367594.768731:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787367594.768736:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367594.768740:0:12971:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787367594.768744:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e8f923199b8) has no exports 00000020:00000080:2.0:1787367594.768830:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8f85be3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787367594.768838:0:12621:0:(genops.c:885:class_export_put()) final put ffff9e8fa0185800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787367594.768840:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fa0185800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787367594.768848:0:12621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787367594.768904:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91ca8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787367594.860166:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367594.860206:0:12971:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787367594.860211:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8f92201000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787367594.860216:0:12971:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f92201000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787367594.860226:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787367594.860364:0:12971:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e8f92200000 00000020:01000000:2.0:1787367594.860394:0:12971:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787367594.860397:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367594.860402:0:12971:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787367594.860406:0:12971:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e8f92318000) has no exports 00000100:00100000:2.0:1787367594.860490:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e8f98800c00:5843] 2 exiting: rc = 0 00000100:00100000:3.0:1787367594.862442:0:6718:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e8fbf895000:6718] 3 exiting: rc = 0 00000100:00100000:3.0:1787367594.862557:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e8f85846e00:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1787367594.862618:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e8f98801c00:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1787367594.862767:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862774:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862780:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862785:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862790:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862795:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862809:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862814:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862820:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862825:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862831:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862837:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862843:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862848:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862854:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862859:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862865:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862870:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862875:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862883:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862889:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862895:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862902:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862908:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862926:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862933:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862939:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862945:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862955:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862963:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862969:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862974:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862980:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862985:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.862991:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863008:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863013:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863019:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863024:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863029:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863035:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863040:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863045:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863049:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863054:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863060:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863065:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863071:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863076:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863081:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863088:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863093:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863098:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863104:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863109:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863113:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863119:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863123:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863129:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863139:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863144:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863151:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863156:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.863166:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367594.867551:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e8f98801000:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787367594.867820:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e8f98800800:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787367594.868156:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868164:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868172:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868178:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868184:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868233:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868240:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868246:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868252:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868257:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868263:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868269:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868276:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868283:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868289:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868295:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868301:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868306:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868311:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868316:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868321:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868326:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868330:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868336:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868340:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868345:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868350:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868354:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868359:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868364:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868390:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868395:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868400:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868405:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868410:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868414:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868419:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868423:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868428:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868433:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868438:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868444:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868454:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868460:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868465:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868470:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868477:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868482:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868487:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868493:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868498:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868503:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868508:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868512:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868583:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868588:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868593:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868597:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868602:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868607:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868611:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868616:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868620:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.868625:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870093:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e8fb8926600:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1787367594.870247:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e8f98800000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787367594.870627:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870635:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870641:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870648:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870654:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870661:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870667:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870673:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870680:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870692:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870698:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870703:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870709:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870714:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870720:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870738:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870744:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870749:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870755:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870760:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870765:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870772:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870778:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870783:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870789:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.870794:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871053:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871075:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871082:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871087:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871093:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871099:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871105:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871111:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871119:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871131:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871136:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871142:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871148:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871165:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871171:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871176:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871182:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871188:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871210:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871217:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871223:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871229:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871235:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871241:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871247:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871266:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871273:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871278:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871284:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871290:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871296:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871302:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871308:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871315:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871321:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871327:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871337:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787367594.871344:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367594.894105:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e8fb8927600:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1787367594.894106:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e8f98801a00:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1787367594.894223:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894232:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894237:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894242:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894247:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894252:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894258:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894263:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894269:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894274:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894280:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894285:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894291:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894296:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894301:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894307:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894312:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894317:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894324:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894329:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894333:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894338:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894343:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894347:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894368:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894384:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894390:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894395:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894400:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894405:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894410:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894415:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894421:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894427:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894432:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894439:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894444:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894448:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894454:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894460:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894465:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894470:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894475:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894480:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894485:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894491:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894496:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894501:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894507:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894512:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894526:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894532:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894537:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894542:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894547:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894551:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894556:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894561:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894566:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894578:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894583:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894588:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894593:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.894597:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367594.895132:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e8fa0098a00:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1787367594.895698:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e8f90463e00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787367594.896294:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896302:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896307:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896312:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896318:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896323:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896329:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896335:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896340:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896344:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896350:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896356:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896361:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896368:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896383:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896389:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896395:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896399:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896405:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896409:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896413:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896418:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896423:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896428:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896434:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896439:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896444:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896448:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896453:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896458:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896475:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896480:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896485:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896490:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896494:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896499:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896509:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896569:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896574:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896579:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896584:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896589:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896594:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896599:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896604:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896609:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896614:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896618:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896623:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896627:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896633:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896638:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896643:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896649:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896654:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896658:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896663:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896668:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896673:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896678:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896684:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896688:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896693:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.896698:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.897916:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e8f8573f600:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1787367594.898181:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e8f86f51400:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1787367594.898315:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898323:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898329:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898334:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898339:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898344:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898349:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898355:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898360:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898365:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898370:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898389:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898395:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898401:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898406:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898412:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898419:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898425:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898431:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898437:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898442:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898448:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898454:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898460:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898465:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898471:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898476:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898482:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898488:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898494:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898501:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898506:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898583:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898593:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898600:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898613:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898618:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898624:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898629:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898634:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898640:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898645:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898650:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898656:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898661:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898666:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898672:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898676:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898682:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898687:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898692:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898697:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898701:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898706:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898711:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898775:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898784:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898789:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898794:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898868:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898876:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898880:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898886:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.898892:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367594.902139:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e8f86c86200:5856] 2 exiting: rc = 0 00000100:00100000:2.0:1787367594.902407:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e8f98803400:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1787367594.902788:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e8f98802a00:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1787367594.903014:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903023:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903028:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903034:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903041:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903048:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903069:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903075:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903081:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903089:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903097:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903102:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903108:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903115:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903121:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903142:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903150:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903155:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903162:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903180:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903187:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903223:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903230:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903236:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903242:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903247:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903254:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903259:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903266:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903272:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903278:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903284:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903290:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903295:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903302:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903308:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903314:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903322:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903328:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903348:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903354:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903366:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903371:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903389:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903393:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903399:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903405:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903411:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903416:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903421:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903427:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903433:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903439:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903445:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903451:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903456:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903462:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903468:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903473:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903478:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903484:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903489:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903495:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367594.903501:0:12971:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787367594.917151:0:12971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367594.917418:0:12971:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787367594.917424:0:12971:0:(genops.c:885:class_export_put()) final put ffff9e8f90241800/MDS_uuid 00000020:00000080:0.0:1787367594.917429:0:12971:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f90241800/MDS_uuid for MDS 00000020:01000000:0.0:1787367594.917435:0:12971:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787367594.917717:0:12971:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787367595.651746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367596.677821:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787367597.127515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787367597.127522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787367597.127526:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787367597.127534:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1787367597.127545:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787367597.127552:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e8fafac1800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1787367597.127577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fbb1caa00 x1874190446711040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787367597.127594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787367597.127598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787367597.127600:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787367597.127603:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1787367597.127605:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787367597.127608:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e8fb3363000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1787367597.127617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fbb1c9500 x1874190446711168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787367597.127639:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367597.127659:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446710912:0@lo:400:kworker.0 00000400:00000100:0.0:1787367597.127719:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190446710912 offset 0 length 224: 4 00000100:00100000:0.0:1787367597.127773:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446711040:0@lo:38:kworker.0 00000400:00000100:0.0:1787367597.127792:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190446711040 offset 0 length 520: 4 00000100:00100000:0.0:1787367597.127804:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446711168:0@lo:38:kworker.0 00000400:00000100:0.0:1787367597.127818:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874190446711168 offset 0 length 520: 4 00010000:00010000:2.0:1787367597.700088:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787367598.192959:0:13128:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787367598.206682:0:13128:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787367598.206741:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.206757:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.206764:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.206771:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.206807:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787367598.206812:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787367598.206834:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367598.206847:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8fbb1caa00 x1874190446711040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367598.206860:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787367598.206866:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787367598.206873:0:13128:0:(import.c:65:import_set_state_nolock()) ffff9e8fafac1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1787367598.206876:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1787367598.206877:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787367598.206882:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8fbb1caa00 x1874190446711040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367612 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787367598.206884:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367598.206889:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:3.0:1787367598.206892:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e000 already unused, calling callback (ffffffffc1ccec20) 00000100:00100000:1.0:1787367598.206892:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 10000000:00010000:3.0:1787367598.206896:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.206916:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367598.206923:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367598.206929:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367598.206932:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787367598.206934:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1787367598.206962:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446711040:0@lo:38:kworker.0 00010000:00010000:3.0:1787367598.206970:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.206975:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367598.207008:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.207015:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f36f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f36fe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.207026:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367598.207027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367598.207029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367598.207035:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367598.207048:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446711296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367598.207114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367598.207208:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446711296 00000100:00100000:2.0:1787367598.207223:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446711296 00000100:00100000:2.0:1787367598.207266:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787367598.207273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1874190446711296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787367598.207280:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787367598 with bad export cookie 14695792843562103776 00010000:00010000:1.0:1787367598.213083:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213105:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213114:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213122:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213156:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367598.213164:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213189:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213213:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213219:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367598.213242:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787367598.213246:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787367598.213268:0:13128:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787367598.213272:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787367598.213277:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367598.213282:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787367598.213286:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e8fbf644d28) has no exports 00000020:00080000:1.0:1787367598.213320:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e8fbf644d28) has no exports 00010000:00010000:3.0:1787367598.214150:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367598.214159:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214169:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fc00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367598.214181:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214340:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367598.214349:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367598.214354:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367598.214357:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787367598.214360:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787367598.214411:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214418:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367598.214452:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214460:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5fc00/0xcbf1f1bac53f3705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f370c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214472:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367598.214476:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214491:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fbf599a00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367598.214494:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214502:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367598.214514:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367598.214519:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787367598.214522:0:7632:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787367598.214523:0:7632:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1787367598.214533:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446711424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367598.214536:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214541:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367598.214546:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214552:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599a00/0xcbf1f1bac53f392e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcbf1f1bac53f3935 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367598.214560:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367598.214561:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367598.214563:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367598.214595:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446711552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367598.214599:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367598.214625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367598.214653:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446711424 00000100:00100000:3.0:1787367598.214660:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446711424 00000100:00100000:3.0:1787367598.214696:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446711552 00000100:00100000:3.0:1787367598.214699:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446711552 00000100:00100000:3.0:1787367598.214710:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367598.214717:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1874190446711424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787367598.214724:0:7633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787367598 with bad export cookie 14695792843562103776 00000100:00100000:3.0:1787367598.214760:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1874190446711424:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (160us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787367598.214773:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367598.214786:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367598.214790:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f92391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1874190446711552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787367598.214794:0:7633:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787367598 with bad export cookie 14695792843562103776 00000100:00100000:3.0:1787367598.214838:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f92391c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1874190446711552:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (213us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787367598.214844:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787367598.214868:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787367598.214872:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e8f90245800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787367598.214876:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787367598.214940:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1787367598.217394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367598.217545:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1874190446711296:12345-0@lo:103:ldlm_bl.0 Request processed in 10266us (10426us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787367598.217557:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787367598.217623:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:1.0:1787367598.218995:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f916927e0 - data ffff9e8f8730b438/ffff9e8fbb288000 00000020:01000000:1.0:1787367598.219147:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f91692ae0 - data ffff9e8f87030e58/ffff9e8fbf9f9000 00000100:00080000:3.0:1787367598.255338:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.123@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787367598.255344:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787367598.255354:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8fbb1cb100 x1874190446710912/t0(0) o400->MGC192.168.204.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787367613 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367598.255383:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8e82067100 x1874190446711296/t0(0) o103->MGC192.168.204.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787367614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367598.255394:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8e82066680 x1874190446711424/t0(0) o103->MGC192.168.204.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787367614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367598.255404:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8e82066d80 x1874190446711552/t0(0) o103->MGC192.168.204.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787367614 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787367598.255413:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787367598.255416:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787367598.255417:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787367598.255526:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89d46cbb-4841-4af3-a474-32a0415d3217:3311:1874190446710912:0@lo:400:kworker.0 00000100:00080000:0.0:1787367598.259653:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e8f90245800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787367598.259688:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89d46cbb-4841-4af3-a474-32a0415d3217:3312:1874190446711424:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787367598.261289:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e8f90245800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787367598.261328:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89d46cbb-4841-4af3-a474-32a0415d3217:3310:1874190446711296:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787367598.264673:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9e8f90245800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787367598.264687:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:3.0:1787367598.264696:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.204.123@tcp: import ffff9e8f90245800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367598.265008:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e82064000 x1874190446711680/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367598.265052:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89d46cbb-4841-4af3-a474-32a0415d3217:3313:1874190446711552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367598.265821:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89d46cbb-4841-4af3-a474-32a0415d3217:3309:1874190446711680:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787367598.265874:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874190446711680 offset 0 length 520: 4 00100000:10000000:1.0:1787367598.285676:0:13128:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787367598.319214:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3514 00000020:00000080:3.0:1787367598.319225:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fb3c92000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787367598.319245:0:13128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8fb88be800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787367598.319249:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fb88be800 2 00000020:00000080:0.0:1787367598.319317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3c92000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787367598.319360:0:13128:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e8fb88be800 from lustre-OST0000 00000020:00000080:2.0:1787367598.319389:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787367598.319400:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787367598.319404:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fafaa4000/lustre-OST0000_UUID 00000020:00000080:2.0:1787367598.319406:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fafaa4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787367598.319420:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787367598.319478:0:13128:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787367598.319483:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787367598.319487:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787367598.319492:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787367598.319499:0:13128:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e8fbf5fc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787367598.319505:0:13128:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9e8fafce99b8) has exports, disconnecting them 00000020:00080000:2.0:1787367598.319510:0:13128:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e8fbf5fc000), last request at 1787367378 00000020:00000080:2.0:1787367598.319515:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f353e 00000020:00080000:2.0:1787367598.319526:0:13128:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8fbf5fc000): rc 0 00000020:00000080:2.0:1787367598.319531:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fbf5fc000/lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787367598.320242:0:13128:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787367598.320249:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787367598.320253:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000020:00000080:0.0:1787367598.320256:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf5fc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1787367598.320259:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787367598.320358:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fafac1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787367598.322603:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367598.322614:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787367598.322620:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fbf5f9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787367598.322624:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf5f9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787367598.322633:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787367598.322689:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fb88be800 1 00000020:00000080:3.0:1787367598.322696:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f34ce 00000020:00000080:3.0:1787367598.322703:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fa0187000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787367598.322721:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787367598.322727:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367598.322732:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787367598.322736:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e8fafceb370) has no exports 00000020:00000080:0.0:1787367598.323348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fa0187000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787367598.361164:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787367598.361180:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787367598.361185:0:13128:0:(genops.c:885:class_export_put()) final put ffff9e8fb88bb800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787367598.361211:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb88bb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787367598.361219:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787367598.361359:0:13128:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e8fb88bf800 00000020:02000400:0.0:1787367598.361401:0:13128:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787367598.723464:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367599.752577:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367600.771948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787367601.507684:0:13279:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787367601.525438:0:13279:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787367601.525522:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.525538:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.525546:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.525554:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.525598:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787367601.525603:0:13279:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787367601.525627:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367601.525639:0:13279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8fbb1c9500 x1874190446711168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367601.525660:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787367601.525667:0:13279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787367601.525674:0:13279:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3363000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787367601.525679:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367601.525683:0:13279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8fbb1c9500 x1874190446711168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787367612 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367601.525690:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787367601.525693:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1787367601.526279:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446711168:0@lo:38:kworker.0 00010000:00010000:3.0:1787367601.526353:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367601.526360:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367601.526369:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367601.526373:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367601.526401:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367601.526409:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367601.526415:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367601.526424:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787367601.526426:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787367601.526439:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e8f90245800 00010000:00010000:3.0:1787367601.526443:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367601.526450:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175600/0xcbf1f1bac53f36db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f36e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367601.526462:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367601.526464:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367601.526465:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367601.527132:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527143:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527150:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527157:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527181:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367601.527188:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527227:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527233:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527239:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367601.527272:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787367601.527275:0:13279:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787367601.527294:0:13279:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787367601.527298:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787367601.527302:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787367601.527308:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787367601.527312:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e8fbf640000) has no exports 00010000:00010000:1.0:1787367601.527316:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367601.527322:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527328:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fc2175e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367601.527336:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787367601.527337:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e8fbf640000) has no exports 00010000:00010000:1.0:1787367601.527344:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367601.527351:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367601.527357:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787367601.527359:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787367601.527361:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787367601.527368:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e8f90245800 00010000:00010000:1.0:1787367601.527372:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527378:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2175e00/0xcbf1f1bac53f36e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f36f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527402:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367601.527405:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527411:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fc00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367601.527414:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527427:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367601.527434:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367601.527444:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787367601.527447:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787367601.527448:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787367601.527453:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e8f90245800 00010000:00010000:1.0:1787367601.527456:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527463:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fc00/0xcbf1f1bac53f3920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f3927 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367601.527475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367601.527477:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367601.527479:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367601.527627:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787367601.538564:0:13279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8f83f2a660 - data ffff9e8f8728f510/ffff9e8fbf8fe800 00000020:01000000:0.0:1787367601.538758:0:13279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e8fa1fb3180 - data ffff9e8f9fbab510/ffff9e8fbb393400 00100000:10000000:0.0:1787367601.552572:0:13279:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787367601.596553:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f35df 00000020:00000080:3.0:1787367601.596563:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fbb1a4800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787367601.596581:0:13279:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8fbf411800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787367601.596585:0:13279:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fbf411800 2 00000020:01000004:3.0:1787367601.596588:0:13279:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e8fbf411800 from lustre-OST0001 00000020:00000080:3.0:1787367601.596616:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367601.596626:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787367601.596629:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fbf483800/lustre-OST0001_UUID 00000020:00000080:3.0:1787367601.596632:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf483800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787367601.596639:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1787367601.596768:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbb1a4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787367601.598547:0:13279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 89d46cbb-4841-4af3-a474-32a0415d3217->MGS 00010000:00010000:3.0:1787367601.598569:0:13279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367601.598584:0:13279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367601.598591:0:13279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787367601.598593:0:13279:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787367601.598597:0:13279:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787367601.598612:0:13279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e8f90245800 00010000:00010000:3.0:1787367601.598616:0:13279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174a00/0xcbf1f1bac53f34f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f34f8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367601.598634:0:13279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367601.598640:0:13279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367601.598646:0:13279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787367601.598649:0:13279:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787367601.598650:0:13279:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787367601.598659:0:13279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e8f90245800 00010000:00010000:3.0:1787367601.598662:0:13279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fc2174e00/0xcbf1f1bac53f372f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcbf1f1bac53f3736 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787367601.598679:0:13279:0:(import.c:65:import_set_state_nolock()) ffff9e8f90245800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787367601.598684:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787367601.598686:0:13279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787367601.598688:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787367601.598692:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787367601.598720:0:13279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e8e82064000 x1874190446711680/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787367608 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787367601.598744:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787367601.598747:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1787367601.598997:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89d46cbb-4841-4af3-a474-32a0415d3217:3309:1874190446711680:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1787367601.599066:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787367601.599074:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f33d2 00000020:00000080:3.0:1787367601.599082:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8f90247800/89d46cbb-4841-4af3-a474-32a0415d3217 00000020:01000000:3.0:1787367601.599107:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.123@tcp (flags='') 00000020:00000080:3.0:1787367601.599114:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367601.599121:0:13279:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787367601.599125:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e8f9231cd28) has no exports 00000020:00000080:1.0:1787367601.599278:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f90247800/89d46cbb-4841-4af3-a474-32a0415d3217 for MGC192.168.204.123@tcp 10000000:01000000:0.0:1787367601.603362:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787367601.603808:0:13279:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.123@tcp: client import never connected 00000100:00080000:1.0:1787367601.603814:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787367601.603818:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787367601.603822:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787367601.603824:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787367601.603863:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8f90245800 for MGC192.168.204.123@tcp 00000020:00000080:1.0:1787367601.603887:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787367601.603896:0:13279:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.123@tcp (uuid 89d46cbb-4841-4af3-a474-32a0415d3217) 00000020:00000080:1.0:1787367601.603902:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8f90244800/89d46cbb-4841-4af3-a474-32a0415d3217 00000020:00000080:1.0:1787367601.603906:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f90244800/89d46cbb-4841-4af3-a474-32a0415d3217 for MGC192.168.204.123@tcp 00000020:01000000:1.0:1787367601.603917:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.123@tcp (89d46cbb-4841-4af3-a474-32a0415d3217) 00000020:01000000:1.0:1787367601.604215:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787367601.604221:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787367601.604236:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787367601.604253:0:13279:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e8f91dbd800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787367601.604259:0:13279:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9e8fb3538000) has exports, disconnecting them 00000020:00080000:1.0:1787367601.604264:0:13279:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e8f91dbd800), last request at 1787367395 00000020:00000080:1.0:1787367601.604268:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f3609 00000020:00080000:1.0:1787367601.604283:0:13279:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e8f91dbd800): rc 0 00000020:00000080:1.0:1787367601.604288:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8f91dbd800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787367601.604459:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8f91dbd800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787367601.606268:0:13279:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787367601.606278:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787367601.606283:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787367601.606290:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787367601.606547:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787367601.606688:0:12621:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e8fb3363000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787367601.609253:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787367601.609501:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787367601.609881:0:11168:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9e8f908af200:11168] 2 exiting: rc = 0 00000100:00100000:3.0:1787367601.609947:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e8f91d37000:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1787367601.610167:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e8f91d36800:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787367601.610262:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367601.616143:0:7633:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e8fb3beae00:7633] 3 exiting: rc = 0 00000100:00100000:2.0:1787367601.617815:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e8f91d88400:5826] 0 exiting: rc = 1 00000100:00100000:0.0:1787367601.617920:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e8f85b20400:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1787367601.617934:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e8fa00aec00:5828] 2 exiting: rc = 0 00000100:00100000:3.0:1787367601.620847:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620858:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620866:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620873:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620879:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620885:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620891:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620897:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620902:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620912:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620916:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620921:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620927:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620933:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620945:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620952:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620957:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620978:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620984:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620989:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620994:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.620999:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621005:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621011:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621017:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621023:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621028:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621034:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621040:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621045:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621051:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621056:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621061:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621067:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621072:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621078:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621082:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621087:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621093:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621098:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621104:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621109:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621115:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621119:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621125:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621130:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621135:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621140:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621146:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621151:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621156:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621161:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621174:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621179:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621184:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621188:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621212:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621218:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621317:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621325:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621331:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621335:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621340:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.621345:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787367601.625385:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367601.625399:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787367601.625407:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fb3363800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787367601.625413:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fb3363800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787367601.625420:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787367601.625474:0:13279:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fbf411800 1 00000020:00000080:3.0:1787367601.625480:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcbf1f1bac53f35ae 00000020:00000080:3.0:1787367601.625486:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fbfa05800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787367601.625510:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787367601.625514:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367601.625518:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787367601.625522:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9e8fb353cd28) has no exports 00000020:00000080:0.0:1787367601.625528:0:12621:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbfa05800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787367601.639669:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367601.639684:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787367601.639690:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fbf416000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787367601.639695:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fbf416000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787367601.639703:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787367601.639999:0:13279:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e8fbf416800 00000020:01000000:3.0:1787367601.640025:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787367601.640029:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787367601.640034:0:13279:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787367601.640046:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9e8f9231b370) has no exports 00000020:00000080:3.0:1787367601.640074:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787367601.640080:0:13279:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787367601.640083:0:13279:0:(genops.c:885:class_export_put()) final put ffff9e8fa0182000/OSS_uuid 00000020:00000080:3.0:1787367601.640086:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffff9e8fa0182000/OSS_uuid for OSS 00000020:01000000:3.0:1787367601.640090:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787367601.640163:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e8fba6e8c00:6697] 2 exiting: rc = 0 00000100:00100000:3.0:1787367601.640281:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e8f910efe00:6696] 1 exiting: rc = 0 00000100:00100000:3.0:1787367601.640347:0:8211:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e8fbb3b6000:8211] 3 exiting: rc = 0 00000100:00080000:2.0:1787367601.640481:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787367601.640578:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e8f9055ea00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1787367601.641530:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641542:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641561:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641568:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641575:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641583:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641591:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641599:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641606:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641615:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641623:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641633:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641641:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641650:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641659:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641668:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641677:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641685:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641693:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641697:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641702:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641710:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641719:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641727:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641736:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641754:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641764:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641774:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641784:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641792:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641800:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641808:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641818:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641827:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641836:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641845:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641852:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641858:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641868:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641876:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641884:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641893:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641901:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641910:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641919:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641928:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641938:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641946:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641954:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641963:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641971:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641981:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641989:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.641998:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642008:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642016:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642025:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642034:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642042:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642052:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642069:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642079:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642089:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.642098:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787367601.645379:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e8f910f2200:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1787367601.645472:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e8fba6e8a00:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1787367601.645991:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646000:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646005:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646010:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646016:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646021:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646027:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646033:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646038:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646043:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646049:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646054:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646059:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646064:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646069:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646074:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646079:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646085:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646090:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646095:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646100:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646106:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646111:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646115:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646119:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646124:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646129:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646134:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646139:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646144:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646150:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646168:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646173:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646179:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646184:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646189:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646225:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646230:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646236:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646250:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646256:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646261:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646266:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646272:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646276:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646281:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646286:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646292:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646296:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646301:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646307:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646317:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646325:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646337:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646342:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646348:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646352:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646357:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646361:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646366:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646370:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646375:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646380:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.646385:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.649900:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e8f831b8a00:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1787367601.650186:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e8f831b9400:6703] 2 exiting: rc = 0 00000100:00100000:1.0:1787367601.650630:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e8fa1f67600:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1787367601.652844:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652864:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652871:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652876:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652882:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652887:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652892:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652897:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652903:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652928:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652934:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652939:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652944:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652949:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652955:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652959:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652964:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652970:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652975:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652979:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.652985:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653000:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653006:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653011:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653016:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653021:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653026:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653031:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653036:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653041:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653047:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653052:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653056:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653062:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653066:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653071:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653081:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653086:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653091:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653097:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653101:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653106:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653111:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653116:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653121:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653136:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653141:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653146:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653150:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653155:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653160:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653166:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653171:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653177:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653182:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653187:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653221:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653230:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653235:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653254:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653261:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653270:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653276:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787367601.653282:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.666463:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e8fa1f65800:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1787367601.667351:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e8fa1f65c00:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1787367601.672394:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672405:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672410:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672416:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672422:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672427:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672433:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672439:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672445:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672450:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672455:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672460:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672465:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672471:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672476:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672481:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672487:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672492:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672498:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672503:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672508:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672513:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672518:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672540:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672547:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672553:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672559:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672568:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.672574:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673793:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673801:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673806:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673811:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673817:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673826:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673831:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673836:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673841:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673846:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673850:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673855:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673859:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673864:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673868:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673873:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673877:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673882:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673887:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673891:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673894:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673900:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673905:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673911:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673915:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673921:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673926:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673930:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673935:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673949:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673954:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673959:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673964:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673969:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.673974:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.675850:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e8fa1f67400:6707] 1 exiting: rc = 0 00000100:00100000:2.0:1787367601.676013:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e8fa1f66a00:6706] 0 exiting: rc = 1 00000100:00100000:1.0:1787367601.676140:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676148:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676357:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676364:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676370:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676376:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676440:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676448:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676453:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676459:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676470:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676476:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676481:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676487:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676506:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676513:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676519:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676525:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676531:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676538:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676546:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676553:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676558:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676564:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676570:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676575:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676598:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676606:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676624:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676631:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676637:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676642:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676647:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676654:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676660:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676667:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676673:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676679:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676700:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676707:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676712:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676718:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676724:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676730:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676736:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676743:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676750:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676756:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676763:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676769:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676791:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676799:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676806:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676813:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676821:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676827:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676835:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676841:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676847:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676853:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676860:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676866:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676873:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787367601.676892:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787367601.692643:0:13279:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787367619.045989:0:13897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787367629.232854:0:14358:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787367629.232859:0:14358:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787367629.233045:0:14358:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e8fbaec6800 00000020:01000004:1.0:1787367629.233062:0:14358:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787367629.233070:0:14358:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787367629.233085:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e8fafcecd28) 00000020:00000080:1.0:1787367629.233099:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787367629.257162:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787367629.260802:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787367629.261548:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1787367629.261735:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1787367629.263336:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787367629.263540:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787367629.263619:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1787367629.263731:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787367629.264608:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787367629.265658:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1787367629.268423:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 223: rc = 0 00100000:10000000:2.0:1787367629.268625:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 223: rc = 0 00100000:10000000:2.0:1787367629.270113:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.270485:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 394: rc = 0 00100000:10000000:2.0:1787367629.271065:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.271484:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 394: rc = 0 00100000:10000000:2.0:1787367629.272078:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.272393:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 394: rc = 0 00100000:10000000:2.0:1787367629.273077:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 394: rc = 0 00100000:10000000:2.0:1787367629.274146:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 394: rc = 0 00100000:10000000:2.0:1787367629.274605:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.275136:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 394: rc = 0 00100000:10000000:2.0:1787367629.275763:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.276347:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 394: rc = 0 00100000:10000000:2.0:1787367629.277074:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 657: rc = 0 00100000:10000000:2.0:1787367629.277460:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 657: rc = 0 00100000:10000000:2.0:1787367629.278044:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 657: rc = 0 00100000:10000000:2.0:1787367629.278404:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 657: rc = 0 00100000:10000000:2.0:1787367629.278986:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 657: rc = 0 00100000:10000000:3.0:1787367629.279637:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 657: rc = 0 00100000:10000000:3.0:1787367629.280471:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 657: rc = 0 00100000:10000000:3.0:1787367629.281332:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 657: rc = 0 00100000:10000000:3.0:1787367629.281667:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 657: rc = 0 00100000:10000000:3.0:1787367629.282267:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 657: rc = 0 00100000:10000000:3.0:1787367629.282484:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 657: rc = 0 00100000:10000000:3.0:1787367629.283036:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 657: rc = 0 00100000:10000000:3.0:1787367629.283773:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 657: rc = 0 00100000:10000000:3.0:1787367629.284468:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 657: rc = 0 00100000:10000000:3.0:1787367629.285138:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 657: rc = 0 00100000:10000000:3.0:1787367629.285663:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 657: rc = 0 00100000:10000000:3.0:1787367629.286253:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 657: rc = 0 00100000:10000000:3.0:1787367629.286525:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 657: rc = 0 00100000:10000000:3.0:1787367629.286808:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 657: rc = 0 00100000:10000000:3.0:1787367629.287077:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 657: rc = 0 00100000:10000000:3.0:1787367629.288283:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 657: rc = 0 00100000:10000000:3.0:1787367629.288569:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 657: rc = 0 00100000:10000000:3.0:1787367629.288842:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 657: rc = 0 00100000:10000000:3.0:1787367629.290043:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 657: rc = 0 00100000:10000000:3.0:1787367629.290379:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 657: rc = 0 00100000:10000000:3.0:1787367629.290952:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 657: rc = 0 00100000:10000000:3.0:1787367629.291371:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 657: rc = 0 00100000:10000000:3.0:1787367629.292027:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 657: rc = 0 00100000:10000000:3.0:1787367629.292338:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 657: rc = 0 00100000:10000000:3.0:1787367629.292648:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 657: rc = 0 00100000:10000000:3.0:1787367629.293116:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 657: rc = 0 00100000:10000000:3.0:1787367629.293440:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 657: rc = 0 00100000:10000000:3.0:1787367629.294335:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 646: rc = 0 00100000:10000000:3.0:1787367629.295301:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787367629.295461:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1787367629.295959:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787367629.296030:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1787367629.296323:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787367629.296389:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787367629.297381:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787367629.297460:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 224: rc = 0 00100000:10000000:3.0:1787367629.298005:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787367629.298079:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 224: rc = 0 00100000:10000000:3.0:1787367629.298367:0:14358:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787367629.298439:0:14358:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 224: rc = 0 00000020:00000080:3.0:1787367629.299445:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787367629.299456:0:14358:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787367629.299470:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f46d3 00000020:01000004:3.0:1787367629.299479:0:14358:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787367629.299484:0:14358:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787367629.299490:0:14358:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8fbaec6800 from MGS 00000020:01000004:3.0:1787367629.299495:0:14358:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787367629.299505:0:14358:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e8fbf640000) 00000020:00000080:3.0:1787367629.299586:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787367629.299642:0:14358:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fbaec6800 from MGS, refs=2 00080000:01000000:3.0:1787367629.299647:0:14358:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787367629.299652:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f46e1 00000100:00100000:3.0:1787367629.300054:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787367629.300299:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787367629.300306:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787367629.302468:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787367629.302483:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787367629.303756:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367629.304353:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787367629.304360:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787367629.308100:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787367629.308115:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787367629.308856:0:14358:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787367629.308865:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787367629.310080:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367629.310085:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367629.310086:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367629.310501:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367629.310504:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367629.310506:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367629.311657:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787367629.316153:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787367629.328664:0:14358:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787367629.328850:0:14358:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787367629.328853:0:14358:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787367629.332078:0:14367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787367629.332303:0:14358:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787367629.332411:0:14358:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787367629.335494:0:14358:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787367629.336401:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787367629.337824:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787367629.337834:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787367629.338806:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787367629.338815:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787367629.339510:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787367629.339517:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787367629.342050:0:14372:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787367629.342111:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787367629.342139:0:14358:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.123@tcp' 00000020:01000004:3.0:1787367629.342141:0:14358:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787367629.342397:0:14358:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.123@tcp (typ=mgc) 00000020:00000080:3.0:1787367629.342410:0:14358:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.123@tcp (ffff9e8fbf643370) 00000020:00000080:3.0:1787367629.342427:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787367629.342657:0:14358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fb3c94000@MGC192.168.204.123@tcp: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1787367629.343157:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.123@tcp-0 is initialized 00000040:01000000:2.0:1787367629.343353:0:14358:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787367629.346318:0:14373:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787367629.346386:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.123@tcp (uuid 74b4a5c6-75ad-491b-a27a-c62858f32053) 00000020:00000080:2.0:1787367629.346413:0:14358:0:(genops.c:1385:class_connect()) connect: client 74b4a5c6-75ad-491b-a27a-c62858f32053, cookie 0xcbf1f1bac53f46ef 00000100:00080000:2.0:1787367629.346427:0:14358:0:(import.c:510:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367629.346434:0:14358:0:(import.c:624:import_select_connection()) MGC192.168.204.123@tcp: import ffff9e8fb3c94000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367629.346467:0:14358:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340d500 x1874190446711808/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367629.346502:0:14358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 74b4a5c6-75ad-491b-a27a-c62858f32053->MGS 00000100:00100000:1.0:1787367629.346648:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74b4a5c6-75ad-491b-a27a-c62858f32053:3309:1874190446711808:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787367629.346743:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787367629.346846:0:14358:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787367629.346851:0:14358:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787367629.346865:0:14358:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e8fb35399b8) 00000020:00000080:2.0:1787367629.346949:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787367629.347918:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446711808 00000100:00100000:0.0:1787367629.347929:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446711808 00000100:00100000:0.0:1787367629.347963:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787367629.347971:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874190446711808:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787367629.348001:0:14369:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 74b4a5c6-75ad-491b-a27a-c62858f32053@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1787367629.348026:0:14369:0:(genops.c:1385:class_connect()) connect: client 74b4a5c6-75ad-491b-a27a-c62858f32053, cookie 0xcbf1f1bac53f46fd 00000100:00080000:0.0:1787367629.348186:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb38b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367629.348298:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+5:3309:x1874190446711808:12345-0@lo:250:mount.lustre.0 Request processed in 325us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.348307:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367629.348496:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787367629.348507:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1787367629.348527:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787367629.348533:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787367629.348538:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3c94000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787367629.348542:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787367629.348624:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787367629.348631:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74b4a5c6-75ad-491b-a27a-c62858f32053:3309:1874190446711808:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787367629.358433:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367629.358812:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787367629.358818:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787367629.359425:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367629.359432:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787367629.361543:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787367629.361553:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787367629.363022:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367629.363750:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787367629.363758:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787367629.364669:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787367629.364678:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787367629.409570:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787367629.410341:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787367629.410349:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787367629.412836:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787367629.412849:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787367629.413416:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367629.413607:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787367629.413612:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787367629.414420:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787367629.414427:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787367629.414983:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367629.415141:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787367629.415146:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787367629.417070:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787367629.417083:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787367629.417672:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367629.417855:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787367629.417860:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787367629.419046:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787367629.419055:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787367629.441146:0:14358:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367629.441444:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787367629.441451:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787367629.442934:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787367629.442947:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787367629.443799:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787367629.443807:0:14358:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787367629.445118:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787367629.445141:0:14358:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787367629.445148:0:14358:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787367629.445418:0:14358:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787367629.445455:0:14358:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787367629.445459:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787367629.445461:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787367629.445462:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367629.445463:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367629.445464:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367629.445465:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367629.445466:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787367629.445468:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787367629.445469:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367629.445471:0:14358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787367629.445474:0:14358:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787367629.445476:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787367629.445477:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787367629.445479:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367629.445480:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367629.445481:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367629.445482:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367629.445488:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787367629.445489:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787367629.445490:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367629.445491:0:14358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787367629.445525:0:14358:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787367629.445548:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446711936:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787367629.445629:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.445734:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.445782:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446711936 00000100:00100000:0.0:1787367629.445791:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446711936 00000100:00100000:0.0:1787367629.445941:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367629.445951:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+5:14358:x1874190446711936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787367629.446081:0:14371:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787367629.446085:0:14371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787367629.446088:0:14371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787367629.447160:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787367629.447731:0:14371:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787367629.449115:0:14394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787367629.449121:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787367629.449124:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787367629.449157:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787367629.449557:0:14371:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787367629.449569:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787367629.459252:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+5:14358:x1874190446711936:12345-0@lo:253:mount.lustre.0 Request processed in 13288us (13608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.459277:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367629.459312:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446711936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787367629.459331:0:14358:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787367629.459335:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787367629.459336:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787367629.459338:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367629.459340:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367629.459341:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367629.459342:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367629.459344:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787367629.459345:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787367629.459348:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367629.459349:0:14358:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787367629.459375:0:14358:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8fbaec6800 from lustre-MDT0000 10000000:01000000:2.0:1787367629.459406:0:14358:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787367629.459409:0:14358:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787367629.459415:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e8fbf643370 10000000:01000000:2.0:1787367629.459420:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787367629.459435:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e8fbf643370 from 1 10000000:01000000:2.0:1787367629.459440:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787367629.459491:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.459503:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.459522:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.460113:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787367629.460260:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.460347:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.460397:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712064 00000100:00100000:0.0:1787367629.460406:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712064 00000100:00100000:0.0:1787367629.460487:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367629.460498:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+5:14358:x1874190446712064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367629.460511:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367629.460661:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf599600/0xcbf1f1bac53f470b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4704 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.460823:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf599600/0xcbf1f1bac53f470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4704 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.462125:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf599600/0xcbf1f1bac53f470b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4704 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.462137:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599600, rc 0) 00000100:00100000:0.0:1787367629.462523:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+6:14358:x1874190446712064:12345-0@lo:101:mount.lustre.0 Request processed in 2026us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.462541:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367629.463137:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367629.463394:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.463407:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.463489:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.463797:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.463963:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.464019:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712192 00000100:00100000:1.0:1787367629.464025:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712192 00000100:00100000:1.0:1787367629.464075:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367629.464084:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+6:14358:x1874190446712192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367629.464504:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+6:14358:x1874190446712192:12345-0@lo:501:mount.lustre.0 Request processed in 420us (969us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367629.464512:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367629.465308:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712192:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787367629.465362:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787367629.465445:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.465456:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367629.465465:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8fbaec6800 10000000:01000000:0.0:1787367629.465471:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367629.465476:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e8fbaec6800 10000000:01000000:0.0:1787367629.465479:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787367629.465482:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e8fbaec6800 from 1 10000000:01000000:0.0:1787367629.465484:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787367629.465516:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.465523:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.465544:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367629.465586:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787367629.465638:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367629.465683:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf4540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367629.465748:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712320 00000100:00100000:2.0:1787367629.465755:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712320 00000100:00100000:2.0:1787367629.465803:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367629.465811:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+6:14358:x1874190446712320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367629.465823:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367629.465837:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a75000/0xcbf1f1bac53f4719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4712 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.465859:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a75000/0xcbf1f1bac53f4719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4712 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.465882:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a75000/0xcbf1f1bac53f4719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4712 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.465890:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75000, rc 0) 00000100:00100000:2.0:1787367629.465940:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+7:14358:x1874190446712320:12345-0@lo:101:mount.lustre.0 Request processed in 129us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.465947:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367629.466068:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787367629.466081:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4719 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.466090:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4719 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367629.466106:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787367629.466406:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4719 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.466415:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599c00/0xcbf1f1bac53f4712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4719 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367629.466422:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787367629.466427:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787367629.466432:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e8fbaec6800 10000000:01000000:1.0:1787367629.466435:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787367629.466437:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787367629.466439:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787367629.466459:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.466472:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.466480:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367629.466495:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787367629.466526:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.466593:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.466679:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712448 00000100:00100000:0.0:1787367629.466684:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712448 00000100:00100000:0.0:1787367629.466754:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367629.466762:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+7:14358:x1874190446712448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367629.466771:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367629.466780:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf599200/0xcbf1f1bac53f4727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4720 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.466796:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf599200/0xcbf1f1bac53f4727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4720 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.466806:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf599200/0xcbf1f1bac53f4727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4720 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.466813:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599200, rc 0) 00000100:00100000:0.0:1787367629.466851:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+8:14358:x1874190446712448:12345-0@lo:101:mount.lustre.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.466857:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367629.466921:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787367629.466933:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4727 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.466940:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4727 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367629.466991:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367629.467015:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.467218:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367629.467382:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712576 00000100:00100000:2.0:1787367629.467386:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712576 00000100:00100000:2.0:1787367629.467406:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367629.467412:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+8:14358:x1874190446712576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.468066:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14358:x1874190446712576:12345-0@lo:501:mount.lustre.0 Request processed in 651us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.468074:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367629.468182:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367629.468244:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787367629.468287:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.468311:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367629.468396:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712704 00000100:00100000:2.0:1787367629.468401:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712704 00000100:00100000:2.0:1787367629.468423:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787367629.468430:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14358:x1874190446712704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.471353:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14358:x1874190446712704:12345-0@lo:503:mount.lustre.0 Request processed in 2914us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.471367:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367629.471613:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446712704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.473584:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14395:1874190446712832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367629.473668:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.473774:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.473815:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446712832 00000100:00100000:0.0:1787367629.473821:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446712832 00000100:00100000:0.0:1787367629.473908:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367629.473918:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14395:x1874190446712832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787367629.474288:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14395:x1874190446712832:12345-0@lo:502:llog_process_th.0 Request processed in 370us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.474306:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367629.474395:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14395:1874190446712832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367629.474430:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367629.474441:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.474443:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787367629.474449:0:14395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787367629.474451:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367629.474466:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e8fb353cd28) 00000020:00000080:2.0:1787367629.474483:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787367629.474488:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787367629.474551:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787367629.474562:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f4735 00000020:00000080:2.0:1787367629.474776:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787367629.474780:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367629.474784:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.474786:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787367629.474789:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367629.474793:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.474794:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787367629.474797:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367629.474804:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e8fb3538000) 00000020:00000080:2.0:1787367629.474814:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787367629.474817:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787367629.474819:0:14395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787367629.474822:0:14395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787367629.474827:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787367629.474876:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fbaec6800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787367629.474889:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e8fb353b370) 00000020:00000080:2.0:1787367629.474897:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787367629.474938:0:14395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787367629.474943:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f474a 00000020:00000080:2.0:1787367629.475032:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787367629.475039:0:14395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787367629.475043:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcbf1f1bac53f4751 00080000:01000000:2.0:1787367629.475054:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787367629.475058:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f4758 00010000:00010000:0.0:1787367629.594047:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787367629.594520:0:14395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787367629.594729:0:14395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787367629.599609:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e8f9231b370) 00000020:00000080:2.0:1787367629.599632:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787367629.599722:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787367629.599729:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f4766 00000020:00000080:2.0:1787367629.603536:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787367629.631647:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcbf1f1bac53f476d 00000020:00000080:0.0:1787367629.632338:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787367629.632353:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367629.632362:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.632364:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787367629.632368:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787367629.632371:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787367629.632373:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787367629.632375:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787367629.632376:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787367629.632379:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.632381:0:14395:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787367629.632383:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787367629.632388:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.632390:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787367629.632395:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787367629.632436:0:14395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787367629.632451:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367629.632455:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.632456:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787367629.632459:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787367629.632462:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787367629.632465:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.632467:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787367629.632470:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787367629.632475:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:0.0:1787367629.632507:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787367629.632510:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367629.632533:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e8fbc0e4d28) 00000020:00000080:0.0:1787367629.632549:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787367629.632659:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787367629.632902:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787367629.632909:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787367629.632916:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f477b 00010000:00080000:0.0:1787367629.632949:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8e81d4a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:0.0:1787367629.633487:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787367629.634777:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787367629.637920:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787367629.640935:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367629.641008:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787367629.641093:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787367629.641629:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787367629.641634:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787367629.642487:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787367629.642498:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787367629.642526:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787367629.642544:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f4782 00000100:00080000:2.0:1787367629.642617:0:14395:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367629.642624:0:14395:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e8e81d4a000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367629.642660:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340d880 x1874190446712960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367629.642796:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446712960:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787367629.642930:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190446712960 offset 0 length 520: 4 00000100:00080000:2.0:1787367629.643030:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787367629.643084:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367629.643088:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.643090:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787367629.643093:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787367629.643096:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787367629.643097:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787367629.643099:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787367629.643100:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787367629.643102:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.643104:0:14395:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787367629.643106:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787367629.643109:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787367629.643112:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.643119:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787367629.643122:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787367629.643125:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:2.0:1787367629.643144:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787367629.643146:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367629.643167:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e8f9231cd28) 00000020:00000080:2.0:1787367629.643179:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787367629.643183:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787367629.643298:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787367629.643305:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787367629.643310:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcbf1f1bac53f4790 00010000:00080000:2.0:1787367629.643336:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fb88bb800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1787367629.643523:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787367629.643711:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787367629.643732:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787367629.644300:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367629.644369:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787367629.644441:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787367629.645482:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787367629.645488:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787367629.646495:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787367629.646509:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787367629.646546:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787367629.646761:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f4797 00000100:00080000:2.0:1787367629.646774:0:14395:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367629.646781:0:14395:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367629.646824:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340fb80 x1874190446713088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367629.647049:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787367629.647125:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446713088:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787367629.647214:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190446713088 offset 0 length 520: 4 00000020:01000000:2.0:1787367629.647348:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367629.647368:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.647369:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787367629.647372:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367629.647376:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.647378:0:14395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787367629.647380:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787367629.647382:0:14395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787367629.647384:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367629.647386:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.647387:0:14395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787367629.647390:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367629.647392:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.647393:0:14395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787367629.647397:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787367629.647430:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14395:1874190446713216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367629.647487:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.647518:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.647579:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713216 00000100:00100000:1.0:1787367629.647586:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713216 00000100:00100000:1.0:1787367629.647639:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787367629.647647:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14395:x1874190446713216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367629.648239:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14395:x1874190446713216:12345-0@lo:502:llog_process_th.0 Request processed in 591us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.648248:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787367629.648348:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14395:1874190446713216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787367629.648394:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367629.648399:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367629.648400:0:14395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787367629.648405:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787367629.648785:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787367629.648809:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787367629.648845:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4727 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.648858:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5f400/0xcbf1f1bac53f4720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4727 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367629.648866:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8fbaec6800 from 1 10000000:01000000:1.0:1787367629.648869:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787367629.648900:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.648907:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.648916:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367629.648942:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787367629.648977:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.648994:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.649130:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713344 00000100:00100000:0.0:1787367629.649136:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713344 00000100:00100000:0.0:1787367629.649221:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787367629.649231:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+9:14358:x1874190446713344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367629.649243:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367629.649258:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f479e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.649280:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.649292:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.649300:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598e00, rc 0) 00000100:00100000:0.0:1787367629.649334:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+10:14358:x1874190446713344:12345-0@lo:101:mount.lustre.0 Request processed in 105us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.649340:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367629.649913:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787367629.649928:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.649938:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367629.650495:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713472:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787367629.650560:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.650593:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.651010:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713472 00000100:00100000:0.0:1787367629.651018:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713472 00000100:00100000:0.0:1787367629.651068:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787367629.651078:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+10:14358:x1874190446713472:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787367629.651097:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787367629.651103:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787367629.651225:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+10:14358:x1874190446713472:12345-0@lo:256:mount.lustre.0 Request processed in 149us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.651232:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367629.651374:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787367629.652327:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787367629.652350:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.652362:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367629.652371:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbaec6800 from 1 10000000:01000000:2.0:1787367629.652384:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367629.652423:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.652431:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.652443:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.652463:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787367629.652522:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.653022:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713600 00000100:00100000:1.0:1787367629.653028:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713600 00000100:00100000:1.0:1787367629.653074:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787367629.653083:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+10:14358:x1874190446713600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787367629.653096:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367629.653116:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f47ac expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.653137:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.653147:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.653330:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7600 going to sleep for 11 seconds 00010000:00010000:1.0:1787367629.653828:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e400, rc 0) 00000100:00100000:1.0:1787367629.654022:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446713600:12345-0@lo:101:mount.lustre.0 Request processed in 938us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.654030:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367629.654287:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367629.654307:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.654318:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.654386:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.654423:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.654489:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.655085:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713728 00000100:00100000:1.0:1787367629.655092:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713728 00000100:00100000:1.0:1787367629.655183:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787367629.655220:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446713728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367629.655630:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446713728:12345-0@lo:501:mount.lustre.0 Request processed in 438us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.655637:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367629.655742:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.655786:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.655828:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.656497:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.656616:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713856 00000100:00100000:0.0:1787367629.656623:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713856 00000100:00100000:0.0:1787367629.656656:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787367629.656746:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446713856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787367629.656956:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446713856:12345-0@lo:503:mount.lustre.0 Request processed in 293us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367629.656963:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367629.657118:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446713856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787367629.658392:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14403:1874190446713984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367629.658462:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367629.658545:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.658641:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446713984 00000100:00100000:0.0:1787367629.658648:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446713984 00000100:00100000:0.0:1787367629.658806:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367629.658816:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14403:x1874190446713984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367629.659499:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14403:x1874190446713984:12345-0@lo:502:llog_process_th.0 Request processed in 681us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.659508:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367629.659602:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14403:1874190446713984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787367629.659640:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367629.659649:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367629.659651:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787367629.659659:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fbaec6800 00000020:00000080:3.0:1787367629.659662:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367629.659679:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367629.659683:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367629.659684:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787367629.659686:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367629.659689:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367629.659705:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787367629.659710:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8fbaec6800 00000020:00000080:3.0:1787367629.659712:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367629.659782:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367629.659786:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367629.659788:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787367629.659791:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367629.659793:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367629.659795:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787367629.659798:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8fbaec6800 00000020:00000080:3.0:1787367629.659800:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787367629.659854:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14403:1874190446714112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367629.659895:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.669311:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714112 00000100:00100000:1.0:1787367629.669327:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714112 00000100:00100000:1.0:1787367629.669375:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787367629.669387:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14403:x1874190446714112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367629.671793:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14403:x1874190446714112:12345-0@lo:502:llog_process_th.0 Request processed in 2401us (11890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.671806:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787367629.673095:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92275a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367629.673134:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14403:1874190446714112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787367629.673188:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787367629.673212:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367629.673214:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787367629.673219:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787367629.674984:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787367629.675016:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367629.675038:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.675050:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367629.675099:0:14358:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787367629.675103:0:14358:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8fbaec6800 10000000:01000000:2.0:1787367629.675105:0:14358:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8fbaec6800 10000000:01000000:2.0:1787367629.675110:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787367629.675116:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8fbaec6800 from 1 10000000:01000000:2.0:1787367629.675119:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787367629.675932:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.675946:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.675961:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.675991:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787367629.676068:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.676107:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367629.676184:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714240 00000100:00100000:2.0:1787367629.676204:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714240 00000100:00100000:2.0:1787367629.676245:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787367629.676254:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446714240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367629.676268:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367629.676282:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a74400/0xcbf1f1bac53f47c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f47ba expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.676305:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a74400/0xcbf1f1bac53f47c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47ba expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.676317:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a74400/0xcbf1f1bac53f47c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47ba expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.676326:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74400, rc 0) 00000100:00100000:2.0:1787367629.676367:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446714240:12345-0@lo:101:mount.lustre.0 Request processed in 114us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.676374:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787367629.676415:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367629.676430:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47c1 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.676440:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f47c1 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.676497:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.676522:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.676531:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.676789:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714368 00000100:00100000:1.0:1787367629.676794:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714368 00000100:00100000:1.0:1787367629.676812:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787367629.676817:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446714368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367629.677460:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446714368:12345-0@lo:501:mount.lustre.0 Request processed in 639us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.677469:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787367629.677941:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367629.677995:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.678040:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.678067:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367629.678089:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714496 00000100:00100000:2.0:1787367629.678094:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714496 00000100:00100000:2.0:1787367629.678117:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367629.678124:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446714496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.678772:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446714496:12345-0@lo:503:mount.lustre.0 Request processed in 646us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.678780:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787367629.678819:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446714496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367629.682365:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14407:1874190446714624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367629.682470:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.682528:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8faa4a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.683634:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714624 00000100:00100000:1.0:1787367629.683643:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714624 00000100:00100000:1.0:1787367629.684073:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367629.684084:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14407:x1874190446714624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787367629.684412:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14407:x1874190446714624:12345-0@lo:502:llog_process_th.0 Request processed in 330us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.684420:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787367629.684523:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14407:1874190446714624:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787367629.684610:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787367629.684627:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e8f92318000) 00000020:00000080:2.0:1787367629.684652:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787367629.684767:0:14407:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8fbaec6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787367629.684773:0:14407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8fbaec6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787367629.684775:0:14407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8fbaec6800 4 00010000:00080000:2.0:1787367629.684807:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fa01ac000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1787367629.686596:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787367629.686868:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787367629.686906:0:14407:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787367629.686932:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcbf1f1bac53f47cf 00000100:00080000:2.0:1787367629.686949:0:14407:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787367629.686958:0:14407:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e8fa01ac000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367629.687012:0:14407:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340df80 x1874190446714752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367629.687068:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446714752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787367629.687161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787367629.687260:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787367629.690311:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714752 00000100:00100000:3.0:1787367629.690325:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714752 00000100:00100000:3.0:1787367629.690373:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367629.690382:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874190446714752:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787367629.690480:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874190446714752:12345-0@lo:38:llog_process_th.0 Request processed in 97us (3319us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787367629.690487:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367629.690546:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367629.690554:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fa01ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367629.690557:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787367629.690561:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446714752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787367629.703422:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14407:1874190446714880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787367629.703515:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.703558:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787367629.705119:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446714880 00000100:00100000:3.0:1787367629.705134:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446714880 00000100:00100000:3.0:1787367629.708456:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787367629.708475:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14407:x1874190446714880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787367629.711052:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14407:x1874190446714880:12345-0@lo:502:llog_process_th.0 Request processed in 2574us (7527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367629.711082:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787367629.722229:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74b4a5c6-75ad-491b-a27a-c62858f32053:14407:1874190446714880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787367629.722282:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787367629.724065:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787367629.724100:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787367629.724119:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47c1 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367629.724131:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74a00/0xcbf1f1bac53f47ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47c1 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787367629.724214:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787367629.724216:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787367629.724217:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367629.724218:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367629.724219:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367629.724221:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367629.724222:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787367629.724223:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787367629.724230:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367629.724231:0:14358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787367629.724234:0:14358:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787367629.724236:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787367629.724238:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787367629.724239:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367629.724240:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367629.724240:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367629.724241:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367629.724242:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787367629.724243:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787367629.724244:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367629.724245:0:14358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787367629.724274:0:14358:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787367629.724295:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446715008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787367629.724369:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367629.724416:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.724555:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715008 00000100:00100000:1.0:1787367629.724563:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715008 00000100:00100000:1.0:1787367629.724613:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367629.724621:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14358:x1874190446715008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787367629.724647:0:14369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787367629.724661:0:14369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787367629.844300:0:14369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787367629.844323:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787367629.844387:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787367629.844393:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787367629.844417:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367629.844438:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367629.844447:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367629.844489:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367629.844503:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 12 pid: 14370 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367629.844518:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446715136:0@lo:104: 00000100:00100000:3.0:1787367629.844588:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367629.844644:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787367629.845183:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715136 00000100:00100000:1.0:1787367629.845219:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715136 00000100:00100000:1.0:1787367629.845263:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367629.845273:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446715136:12345-0@lo:104: 00010000:00010000:1.0:1787367629.845287:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.845376:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367629.845382:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446715136:12345-0@lo:104: Request processed in 112us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.845390:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367629.845432:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446715136:0@lo:104: 00010000:00010000:1.0:1787367629.845452:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.845919:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367629.845932:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.845940:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ee00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:0.0:1787367629.845944:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.845952:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787367629.845958:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367629.845964:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787367629.846275:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.846283:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787367629.846310:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.846318:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ee00/0xcbf1f1bac53f479e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47a5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.846336:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367629.846337:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367629.846340:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367629.846402:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367629.846417:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446715264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367629.846473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367629.846537:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715264 00000100:00100000:1.0:1787367629.846543:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715264 00010000:00010000:1.0:1787367629.846563:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 13 pid: 14370 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367629.846586:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367629.846593:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+13:3311:x1874190446715264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367629.846605:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367629.846610:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 13 pid: 14370 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846621:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 13 pid: 14370 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846635:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fbf598e00/0xcbf1f1bac53f47a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f479e expref: 13 pid: 14370 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846649:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846657:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367629.846673:0:14361:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002280337s 00010000:00010000:1.0:1787367629.846677:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846701:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846709:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846715:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846722:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367629.846727:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846734:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846758:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367629.846768:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367629.846802:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3311:x1874190446715264:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367629.846809:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367629.846856:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446715264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367629.848829:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.848845:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367629.848865:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f47d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367629.860415:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14358:x1874190446715008:12345-0@lo:253:mount.lustre.0 Request processed in 135786us (136036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367629.860430:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787367629.860544:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:14358:1874190446715008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787367629.860560:0:14358:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787367629.860563:0:14358:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367629.860565:0:14358:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787367629.860566:0:14358:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367629.860568:0:14358:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367629.860569:0:14358:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367629.860570:0:14358:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367629.860572:0:14358:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787367629.860573:0:14358:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787367629.860587:0:14358:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367629.860589:0:14358:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787367629.860603:0:14358:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787367629.865963:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367629.866318:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787367629.866603:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367629.866772:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787367629.867390:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367629.867532:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367629.868561:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367629.868706:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367629.869126:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367629.869336:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787367629.869593:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787367629.869769:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787367629.920592:0:14358:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787367629.921328:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787367629.921583:0:14417:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787367629.921659:0:14417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787367629.924071:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787367629.924242:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787367629.924711:0:14358:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787367629.924719:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:0.0:1787367629.927118:0:14416:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787367629.927128:0:14416:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787367629.929280:0:14417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787367629.929365:0:14417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787367629.929385:0:14417:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1787367629.929944:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367629.931456:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787367629.932127:0:14358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787367629.932188:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787367629.934557:0:14358:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787367629.940531:0:14358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787367629.970775:0:14358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787367629.970901:0:14358:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4e1419e7988 00100000:10000000:1.0:1787367629.970912:0:14358:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787367629.971790:0:14358:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787367629.971808:0:14358:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787367629.971846:0:14358:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787367629.971884:0:14358:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787367630.341231:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367630.725836:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787367631.171251:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787367631.171259:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8fbaec6800 from 6 10000000:01000000:3.0:1787367631.171263:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787367631.171313:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367631.171326:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367631.171338:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367631.171366:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446715392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367631.171441:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367631.171576:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715392 00000100:00100000:0.0:1787367631.171583:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715392 00000100:00100000:0.0:1787367631.171624:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787367631.171643:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14373:x1874190446715392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367631.171657:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367631.171679:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f47dd expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367631.171703:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367631.171713:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367631.171723:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598800, rc 0) 00000100:00100000:0.0:1787367631.171768:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446715392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367631.171850:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367631.171874:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446715392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367631.171888:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367631.171898:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367631.171946:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446715520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787367631.171976:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367631.171988:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367631.172149:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787367631.172178:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715520 00000100:00100000:0.0:1787367631.172182:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715520 00000100:00100000:0.0:1787367631.172234:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787367631.172240:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446715520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787367631.172255:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787367631.172272:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787367631.172276:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787367631.172357:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446715520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367631.172365:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787367631.174016:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446715520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787367631.174087:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367631.174096:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367631.174106:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367631.363753:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787367631.759242:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367632.387405:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367633.414115:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367634.435507:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787367635.019672:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787367635.019681:0:12621:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787367635.019683:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787367635.019687:0:12621:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787367635.019689:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787367635.019693:0:12621:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787367635.019697:0:12621:0:(import.c:65:import_set_state_nolock()) ffff9e8fa01ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787367635.019713:0:12621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e8fa01ac000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367635.019741:0:12621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e82064380 x1874190446715776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367635.019784:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446715648:0@lo:400:kworker.0 00000100:00100000:3.0:1787367635.019924:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367635.020000:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446715776:0@lo:38:kworker.0 00000100:00100000:3.0:1787367635.020033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367635.020101:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715648 00000100:00100000:3.0:1787367635.020109:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715648 00000100:00100000:3.0:1787367635.020153:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367635.020161:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3311:x1874190446715648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367635.020249:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3311:x1874190446715648:12345-0@lo:400:kworker.0 Request processed in 88us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367635.020257:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787367635.020312:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446715648:0@lo:400:kworker.0 00000100:00100000:1.0:1787367635.022929:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715776 00000100:00100000:1.0:1787367635.022944:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715776 00000100:00100000:1.0:1787367635.022986:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367635.022994:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874190446715776:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787367635.023023:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1787367635.023065:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcbf1f1bac53f47eb 00000004:00100000:1.0:1787367635.023083:0:14378:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787367635.023243:0:14378:0:(import.c:65:import_set_state_nolock()) ffff9e8f85a73800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367635.023330:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874190446715776:12345-0@lo:38:kworker.0 Request processed in 336us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367635.023337:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787367635.023396:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8e82064380 x1874190446715776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787367635.023413:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787367635.023420:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787367635.023425:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787367635.023428:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fa01ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787367635.023452:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874190446715776:0@lo:38:kworker.0 00000001:02000400:0.0:1787367635.083488:0:14659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787367635.461766:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367636.483391:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367637.511051:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787367638.446695:0:14810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca2e1d5e0 20000000:00000080:1.0:1787367638.446714:0:14810:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fbc4be800 uarg=0000000000000000 20000000:01000000:1.0:1787367638.446749:0:14810:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787367638.446758:0:14810:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787367638.446764:0:14810:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787367638.448175:0:14811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787367638.448374:0:14810:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787367638.455014:0:14810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367638.455052:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367638.455072:0:14810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367638.455080:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367638.455349:0:14810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367638.455367:0:14810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367638.455382:0:14810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1874190446715904:0@lo:104: 00000100:00100000:2.0:1787367638.455448:0:14810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367638.455503:0:14810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fb6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367638.455637:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446715904 00000100:00100000:1.0:1787367638.455645:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446715904 00000100:00100000:1.0:1787367638.455727:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367638.455738:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14810:x1874190446715904:12345-0@lo:104: 00010000:00010000:1.0:1787367638.455753:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.455884:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367638.455891:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14810:x1874190446715904:12345-0@lo:104: Request processed in 156us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367638.455899:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787367638.455925:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367638.455931:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.455939:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367638.455944:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.455953:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367638.455974:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367638.455979:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787367638.456008:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456014:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367638.456037:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456045:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75e00/0xcbf1f1bac53f47ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47b3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456061:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367638.456063:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367638.456065:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367638.456107:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446716032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367638.456139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367638.456186:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716032 00000100:00100000:1.0:1787367638.456212:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716032 00010000:00010000:1.0:1787367638.456233:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 12 pid: 14369 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367638.456257:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367638.456264:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3312:x1874190446716032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367638.456292:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367638.456299:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 12 pid: 14369 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456316:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 12 pid: 14369 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456336:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456345:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456359:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456365:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456372:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456378:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456383:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367638.456387:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456394:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456403:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.456422:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367638.456452:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3312:x1874190446716032:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367638.456459:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367638.456495:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446716032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787367638.457011:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5e400/0xcbf1f1bac53f47b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f47ac expref: 11 pid: 14369 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367638.457025:0:14810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1874190446715904:0@lo:104: 00010000:00010000:3.0:1787367638.457040:0:14810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367638.457050:0:14810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367638.457055:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367638.457061:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f47f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367638.538331:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367639.107633:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367629/real 1787367629] req@ffff9e8e8340fb80 x1874190446713088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367639 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367639.107688:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e8e8340fb80 x1874190446713088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367639 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367639.107700:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367629/real 1787367629] req@ffff9e8e8340d880 x1874190446712960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367639 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367639.107714:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e8e8340d880 x1874190446712960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367639 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787367639.107739:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367639.107792:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787367639.107796:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446713088:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787367639.107803:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8e81d4a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787367639.107809:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787367639.107812:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446712960:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787367639.108011:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787367639.108025:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787367639.108029:0:475:0:(import.c:65:import_set_state_nolock()) ffff9e8e81d4a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787367639.108034:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1787367639.108040:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787367639.108046:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e8e81d4a000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367639.108077:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340e300 x1874190446716288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787367639.108095:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787367639.108098:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787367639.108100:0:475:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787367639.108103:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1787367639.108105:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787367639.108108:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367639.108120:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340f100 x1874190446716416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367639.108163:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446716544:0@lo:400:kworker.0 00000100:00100000:2.0:1787367639.108259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367639.108538:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74b4a5c6-75ad-491b-a27a-c62858f32053:3313:1874190446716160:0@lo:400:kworker.0 00000100:00100000:1.0:1787367639.108579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367639.108640:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716544 00000100:00100000:1.0:1787367639.108658:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716544 00000100:00100000:1.0:1787367639.108703:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367639.108711:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446716544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367639.108764:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446716544:12345-0@lo:400:kworker.0 Request processed in 54us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367639.108771:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787367639.108817:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8e8340ea00 x1874190446716544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367639.108829:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446716544:0@lo:400:kworker.0 00000100:00100000:2.0:1787367639.109065:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716160 00000100:00100000:2.0:1787367639.109070:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716160 00000100:00100000:2.0:1787367639.109109:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787367639.109117:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:3313:x1874190446716160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367639.109157:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+11:3313:x1874190446716160:12345-0@lo:400:kworker.0 Request processed in 41us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367639.109163:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787367639.109269:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74b4a5c6-75ad-491b-a27a-c62858f32053:3313:1874190446716160:0@lo:400:kworker.0 00000100:00100000:0.0:1787367639.109401:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446716288:0@lo:8:kworker.0 00000400:00000100:0.0:1787367639.109436:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190446716288 offset 0 length 520: 4 00000100:00100000:0.0:1787367639.109457:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446716416:0@lo:8:kworker.0 00000400:00000100:0.0:1787367639.109477:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874190446716416 offset 0 length 520: 4 00010000:00010000:2.0:1787367639.563627:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787367640.003455:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787367640.003542:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbaec6800 from 10 10000000:01000000:1.0:1787367640.003551:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787367640.003622:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367640.004784:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367640.004800:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367640.005085:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787367640.005176:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367640.005276:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367640.005375:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716672 00000100:00100000:2.0:1787367640.005384:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716672 00000100:00100000:2.0:1787367640.005447:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787367640.005457:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+11:14373:x1874190446716672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367640.005483:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367640.005519:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f47f9 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367640.005546:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367640.005558:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367640.005566:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74600, rc 0) 00000100:00100000:2.0:1787367640.005619:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446716672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367640.005627:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367640.006057:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367640.006074:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367640.006084:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367640.006146:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367640.006175:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367640.006445:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367640.006793:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716800 00000100:00100000:2.0:1787367640.006799:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716800 00000100:00100000:2.0:1787367640.007220:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787367640.007230:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446716800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367640.007556:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446716800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367640.007564:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787367640.007656:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367640.007697:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367640.007753:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367640.015831:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446716928 00000100:00100000:3.0:1787367640.015848:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446716928 00000100:00100000:3.0:1787367640.015906:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787367640.015916:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446716928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367640.016189:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:14373:x1874190446716928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (8435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367640.016771:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787367640.020955:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367640.021007:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446716928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787367640.025152:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787367640.025919:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787367640.025946:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367640.025962:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367640.025977:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367640.587327:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367641.605844:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367641.991417:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787367642.628655:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367643.652507:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787367644.231644:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367644.231654:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787367644.231657:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367644.231660:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787367644.231707:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367644.231736:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446717184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367644.231821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.231888:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717184 00000100:00100000:1.0:1787367644.231900:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717184 00000100:00100000:1.0:1787367644.231952:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367644.231962:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446717184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367644.232021:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446717184:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.232028:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787367644.232074:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8fa014f800 x1874190446717184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367644.232087:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446717184:0@lo:400:kworker.0 00000100:00100000:2.0:1787367644.232140:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367644.232151:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446717056:0@lo:400:kworker.0 00000100:00100000:2.0:1787367644.232217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.232568:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717056 00000100:00100000:1.0:1787367644.232574:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717056 00000100:00100000:1.0:1787367644.232604:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787367644.232612:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3310:x1874190446717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367644.232655:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+12:3310:x1874190446717056:12345-0@lo:400:kworker.0 Request processed in 45us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.232684:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787367644.232721:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446717056:0@lo:400:kworker.0 00000020:01000004:0.0:1787367644.598355:0:15060:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787367644.598359:0:15060:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787367644.598479:0:15060:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e8f92201800 00000020:01000004:0.0:1787367644.598497:0:15060:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787367644.598511:0:15060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787367644.598527:0:15060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e8fbc0e0000) 00000020:00000080:0.0:1787367644.598542:0:15060:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787367644.619426:0:15060:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787367644.619806:0:15060:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787367644.620853:0:15060:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787367644.621088:0:15060:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787367644.621479:0:15060:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787367644.622031:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 447: rc = 0 00100000:10000000:2.0:1787367644.622134:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 447: rc = 0 00100000:10000000:2.0:1787367644.622381:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 447: rc = 0 00100000:10000000:2.0:1787367644.622923:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1787367644.623353:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:2.0:1787367644.623615:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:2.0:1787367644.623894:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:2.0:1787367644.624146:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:2.0:1787367644.624611:0:15060:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00000020:00000080:2.0:1787367644.625367:0:15060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787367644.625380:0:15060:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787367644.625392:0:15060:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbf1f1bac53f480e 00000020:01000004:2.0:1787367644.625408:0:15060:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787367644.625429:0:15060:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787367644.625432:0:15060:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787367644.625438:0:15060:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787367644.625443:0:15060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787367644.625454:0:15060:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e8f923199b8) 00000020:00000080:2.0:1787367644.625465:0:15060:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787367644.626680:0:15060:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787367644.626863:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787367644.626869:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787367644.629933:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367644.629949:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787367644.630474:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787367644.630482:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787367644.638992:0:15060:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367644.639447:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787367644.639454:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787367644.640554:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787367644.640564:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787367644.657948:0:15060:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367644.658183:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787367644.658478:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787367644.659818:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787367644.659830:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787367644.660838:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787367644.660848:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787367644.663122:0:15060:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367644.663645:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787367644.663652:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787367644.664605:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787367644.664613:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787367644.675557:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367644.703973:0:15060:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787367644.704218:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787367644.704226:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787367644.706058:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787367644.706072:0:15060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787367644.707519:0:15060:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787367644.707545:0:15060:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787367644.707561:0:15060:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787367644.723116:0:15060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787367644.723161:0:15060:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787367644.723166:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787367644.723167:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787367644.723168:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367644.723170:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367644.723171:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367644.723172:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367644.723173:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787367644.723175:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367644.723176:0:15060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787367644.723180:0:15060:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787367644.723182:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787367644.723184:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787367644.723214:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367644.723216:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367644.723217:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367644.723218:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367644.723219:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787367644.723220:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367644.723221:0:15060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787367644.723266:0:15060:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787367644.723290:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717312:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787367644.723378:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367644.723440:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e0de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.723594:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717312 00000100:00100000:3.0:1787367644.723604:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717312 00000100:00100000:3.0:1787367644.723680:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787367644.723692:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:15060:x1874190446717312:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787367644.723737:0:14371:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787367644.723747:0:14371:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787367644.723783:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787367644.752058:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:15060:x1874190446717312:12345-0@lo:253:mount.lustre.0 Request processed in 28359us (28669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.752073:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787367644.752599:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717312:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787367644.752618:0:15060:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787367644.752621:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787367644.752623:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787367644.752624:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787367644.752625:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787367644.752626:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787367644.752627:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787367644.752628:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787367644.752630:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787367644.752631:0:15060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787367644.752651:0:15060:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8f92201800 from lustre-OST0000 10000000:01000000:0.0:1787367644.752682:0:15060:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787367644.752685:0:15060:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787367644.752693:0:15060:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e8fbf643370 local copy 00010000:00010000:0.0:1787367644.752705:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367644.753044:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787367644.753092:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367644.753137:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e0d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.753459:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717440 00000100:00100000:3.0:1787367644.753466:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717440 00000100:00100000:3.0:1787367644.753506:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787367644.753515:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:15060:x1874190446717440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367644.753743:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+12:15060:x1874190446717440:12345-0@lo:501:mount.lustre.0 Request processed in 228us (649us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367644.753750:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367644.753892:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717440:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787367644.753919:0:15060:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787367644.754137:0:15060:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787367644.754145:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.754155:0:15060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367644.754178:0:15060:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8f92201800 10000000:01000000:0.0:1787367644.754183:0:15060:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367644.754188:0:15060:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e8fbf643370 10000000:01000000:0.0:1787367644.754621:0:15060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787367644.754627:0:15060:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e8fbf643370 from 1 10000000:01000000:0.0:1787367644.754630:0:15060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787367644.754658:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.754665:0:15060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.754674:0:15060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367644.754690:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787367644.754731:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367644.754768:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e0d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.754958:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717568 00000100:00100000:3.0:1787367644.755031:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717568 00000100:00100000:3.0:1787367644.755117:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787367644.755127:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+12:15060:x1874190446717568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787367644.755140:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367644.755155:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f4823 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f481c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.755178:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f4823 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f481c expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.755189:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357ec00/0xcbf1f1bac53f4823 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f481c expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.755454:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357ec00, rc 0) 00000100:00100000:3.0:1787367644.755507:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+13:15060:x1874190446717568:12345-0@lo:101:mount.lustre.0 Request processed in 382us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.755527:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787367644.755635:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367644.755649:0:15060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4823 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.755667:0:15060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4823 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367644.755686:0:15060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787367644.755761:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4823 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.755769:0:15060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599e00/0xcbf1f1bac53f481c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4823 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367644.755777:0:15060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787367644.755782:0:15060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367644.755787:0:15060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787367644.755790:0:15060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787367644.755825:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.755833:0:15060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.755841:0:15060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367644.755856:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787367644.755891:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367644.755926:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e0d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.755982:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717696 00000100:00100000:3.0:1787367644.755987:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717696 00000100:00100000:3.0:1787367644.756021:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787367644.756028:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+13:15060:x1874190446717696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787367644.756036:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367644.756046:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f4831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f482a expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.756061:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f482a expref: 14 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.756069:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f800/0xcbf1f1bac53f4831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f482a expref: 14 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.756075:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f800, rc 0) 00000100:00100000:3.0:1787367644.756104:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446717696:12345-0@lo:101:mount.lustre.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.756109:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787367644.756227:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367644.756238:0:15060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4831 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.756252:0:15060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4831 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367644.757124:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787367644.759726:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367644.760120:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787367644.760167:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787367644.760236:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787367644.760372:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787367644.760424:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787367644.760459:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787367644.760645:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787367644.760659:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787367644.760755:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367644.760828:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.760936:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.760994:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717824 00000100:00100000:3.0:1787367644.761001:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717824 00000100:00100000:3.0:1787367644.761086:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787367644.761096:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446717824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367644.762137:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446717824:12345-0@lo:501:mount.lustre.0 Request processed in 1039us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.762147:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787367644.762366:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367644.762416:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787367644.762458:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.762525:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.762645:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446717952 00000100:00100000:3.0:1787367644.762656:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446717952 00000100:00100000:3.0:1787367644.762716:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787367644.762723:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446717952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787367644.762989:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446717952:12345-0@lo:503:mount.lustre.0 Request processed in 266us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.762996:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787367644.763057:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446717952:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787367644.763884:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787367644.763954:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367644.764004:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.764594:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.764699:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718080 00000100:00100000:0.0:1787367644.764706:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718080 00000100:00100000:0.0:1787367644.764746:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787367644.764754:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446718080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367644.764971:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446718080:12345-0@lo:502:mount.lustre.0 Request processed in 217us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.764978:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787367644.765072:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787367644.765395:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787367644.765454:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787367644.765486:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787367644.765530:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787367644.765581:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787367644.765618:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787367644.765667:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787367644.765705:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787367644.765735:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787367644.765780:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787367644.765814:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787367644.765859:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787367644.765893:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367644.765941:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.765965:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.766379:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718208 00000100:00100000:3.0:1787367644.766386:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718208 00000100:00100000:3.0:1787367644.766436:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787367644.766444:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446718208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367644.766648:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446718208:12345-0@lo:502:mount.lustre.0 Request processed in 205us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.766656:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787367644.766819:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787367644.766895:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787367644.766905:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787367644.768444:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787367644.768457:0:15074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787367644.768466:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787367644.768468:0:15074:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787367644.768476:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787367644.768493:0:15074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e8fbc0e3370) 00000020:00000080:0.0:1787367644.768521:0:15074:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787367644.768527:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787367644.768662:0:15074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8f92201800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787367644.768669:0:15074:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787367644.768676:0:15074:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcbf1f1bac53f483f 00010000:00010000:0.0:1787367644.772526:0:15074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787367644.773060:0:15074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787367644.775908:0:15074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787367644.778063:0:15074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787367644.778078:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367644.778085:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778087:0:15074:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787367644.778091:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787367644.778094:0:15074:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787367644.778095:0:15074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787367644.778097:0:15074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787367644.778098:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787367644.778100:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778101:0:15074:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787367644.778103:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367644.778106:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778116:0:15074:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367644.778120:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367644.778123:0:15074:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787367644.778125:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367644.778127:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778129:0:15074:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787367644.778131:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367644.778133:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778134:0:15074:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787367644.778137:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787367644.778190:0:15074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367644.778214:0:15074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367644.778216:0:15074:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787367644.778220:0:15074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787367644.778454:0:15060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787367644.778481:0:15060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787367644.778507:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4831 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.778519:0:15060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf598c00/0xcbf1f1bac53f482a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4831 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367644.778527:0:15060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92201800 from 1 10000000:01000000:2.0:1787367644.778530:0:15060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787367644.778628:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.778637:0:15060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.778647:0:15060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367644.778672:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787367644.778743:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.778790:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.778885:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718336 00000100:00100000:3.0:1787367644.778892:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718336 00000100:00100000:3.0:1787367644.778937:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787367644.778946:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+14:15060:x1874190446718336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787367644.778959:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367644.778972:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4846 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.778994:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.779005:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367644.779013:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e200, rc 0) 00000100:00100000:3.0:1787367644.779065:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718336:12345-0@lo:101:mount.lustre.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.779072:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787367644.779169:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367644.779184:0:15060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.779229:0:15060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367644.779869:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787367644.780765:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367644.781032:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787367644.781078:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787367644.781157:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787367644.781166:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787367644.782478:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367644.782616:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.782725:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367644.783395:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718464 00000100:00100000:3.0:1787367644.783493:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718464 00000100:00100000:3.0:1787367644.783544:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787367644.783554:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367644.783845:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718464:12345-0@lo:501:mount.lustre.0 Request processed in 292us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.783854:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787367644.783888:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367644.783933:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367644.783979:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.784008:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.784062:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718592 00000100:00100000:0.0:1787367644.784066:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718592 00000100:00100000:0.0:1787367644.784105:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787367644.784112:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718592:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787367644.784608:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718592:12345-0@lo:503:mount.lustre.0 Request processed in 426us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.784618:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787367644.786691:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787367644.787294:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787367644.787380:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367644.787464:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367644.787509:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.787744:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718720 00000100:00100000:0.0:1787367644.787750:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718720 00000100:00100000:0.0:1787367644.787790:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787367644.787800:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367644.787984:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718720:12345-0@lo:502:mount.lustre.0 Request processed in 185us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.787992:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787367644.788085:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367644.788495:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787367644.788618:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787367644.788688:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787367644.788728:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787367644.788762:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787367644.788811:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787367644.788846:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787367644.788876:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787367644.788903:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367644.788946:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367644.789022:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f878c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.789143:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718848 00000100:00100000:0.0:1787367644.789148:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718848 00000100:00100000:0.0:1787367644.789187:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787367644.789225:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367644.789738:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718848:12345-0@lo:502:mount.lustre.0 Request processed in 514us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.789747:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787367644.790002:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367644.790113:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787367644.790125:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787367644.791485:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367644.791496:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791498:0:15078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787367644.791503:0:15078:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f92201800 00000020:00000080:3.0:1787367644.791506:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367644.791513:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367644.791515:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791516:0:15078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787367644.791518:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367644.791521:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791522:0:15078:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787367644.791799:0:15078:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f92201800 00000020:00000080:3.0:1787367644.791801:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367644.791860:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367644.791864:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791865:0:15078:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787367644.791868:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787367644.791871:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791872:0:15078:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787367644.791875:0:15078:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8f92201800 00000020:00000080:3.0:1787367644.791877:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787367644.791915:0:15078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787367644.791919:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787367644.791920:0:15078:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787367644.791923:0:15078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787367644.792039:0:15060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787367644.792070:0:15060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367644.792094:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.792105:0:15060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367644.792146:0:15060:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787367644.792149:0:15060:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8f92201800 10000000:01000000:0.0:1787367644.792152:0:15060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8f92201800 10000000:01000000:0.0:1787367644.792156:0:15060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367644.792162:0:15060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f92201800 from 1 10000000:01000000:0.0:1787367644.792174:0:15060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787367644.792654:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.792665:0:15060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367644.792676:0:15060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367644.792699:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787367644.792761:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367644.792807:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367644.793386:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446718976 00000100:00100000:2.0:1787367644.793394:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446718976 00000100:00100000:2.0:1787367644.793456:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367644.793465:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446718976:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367644.793479:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367644.793493:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a75200/0xcbf1f1bac53f485b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4854 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.793517:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a75200/0xcbf1f1bac53f485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4854 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.793609:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a75200/0xcbf1f1bac53f485b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4854 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.793618:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75200, rc 0) 00000100:00100000:2.0:1787367644.793673:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446718976:12345-0@lo:101:mount.lustre.0 Request processed in 209us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367644.793680:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787367644.793731:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446718976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367644.793747:0:15060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f485b expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367644.793755:0:15060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f485b expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367644.795622:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787367644.795972:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367644.797477:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787367644.797625:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787367644.797664:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787367644.797713:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787367644.797747:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787367644.797810:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787367644.797841:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787367644.797869:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787367644.797914:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787367644.797945:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787367644.797975:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787367644.798016:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787367644.798063:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787367644.798094:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787367644.798141:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787367644.798176:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787367644.798242:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787367644.799490:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787367644.799690:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787367644.799732:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787367644.799822:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787367644.799876:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787367644.799909:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787367644.799952:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787367644.799985:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787367644.800013:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787367644.800061:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787367644.800095:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787367644.800184:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787367644.800231:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787367644.800351:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367644.800433:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.800478:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.800560:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719104 00000100:00100000:0.0:1787367644.800568:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719104 00000100:00100000:0.0:1787367644.800624:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787367644.800633:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787367644.800861:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719104:12345-0@lo:501:mount.lustre.0 Request processed in 228us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.800868:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787367644.801009:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367644.801041:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367644.801081:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.801105:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8e81ba8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.801280:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719232 00000100:00100000:0.0:1787367644.801285:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719232 00000100:00100000:0.0:1787367644.801316:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787367644.801322:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787367644.801474:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719232:12345-0@lo:503:mount.lustre.0 Request processed in 147us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.801481:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787367644.801561:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787367644.802108:0:15060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787367644.802167:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787367644.802331:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.802366:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.802507:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719360 00000100:00100000:0.0:1787367644.802518:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719360 00000100:00100000:0.0:1787367644.802564:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787367644.802572:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367644.802748:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719360:12345-0@lo:502:mount.lustre.0 Request processed in 176us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.802755:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787367644.802876:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787367644.803107:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787367644.803156:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787367644.803224:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787367644.803289:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787367644.803325:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787367644.803385:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787367644.803434:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787367644.803467:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787367644.803510:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787367644.803614:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787367644.803653:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787367644.803699:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787367644.803735:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787367644.803767:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787367644.803813:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787367644.803848:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787367644.803879:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787367644.803941:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787367644.803980:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787367644.804013:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787367644.804060:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787367644.804108:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787367644.804143:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787367644.804188:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787367644.804255:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787367644.804288:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787367644.804336:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787367644.804371:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787367644.804430:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787367644.804479:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787367644.804514:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787367644.805656:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787367644.805720:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787367644.805784:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787367644.805822:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787367644.805870:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787367644.805908:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787367644.805953:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787367644.805990:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787367644.806016:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787367644.806059:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787367644.806134:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367644.806215:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa17d8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787367644.807376:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719488 00000100:00100000:0.0:1787367644.807387:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719488 00000100:00100000:0.0:1787367644.807461:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787367644.807471:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367644.808897:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719488:12345-0@lo:502:mount.lustre.0 Request processed in 1420us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367644.808908:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787367644.810150:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787367644.810331:0:15060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787367644.810350:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787367644.813111:0:15082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787367644.813127:0:15082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e8fbf6419b8) 00000020:00000080:3.0:1787367644.813147:0:15082:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787367644.813264:0:15082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8f92201800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787367644.813272:0:15082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8f92201800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787367644.813275:0:15082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8f92201800 3 00010000:00080000:3.0:1787367644.813316:0:15082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8f918f4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1787367644.817050:0:15082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787367644.817292:0:15082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787367644.817471:0:15082:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787367644.817486:0:15082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcbf1f1bac53f4869 00000100:00080000:3.0:1787367644.817497:0:15082:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787367644.817503:0:15082:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e8f918f4000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367644.818021:0:15082:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e82066d80 x1874190446719616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787367644.818064:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446719616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787367644.818131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.818168:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719616 00000100:00100000:1.0:1787367644.818175:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719616 00000100:00080000:3.0:1787367644.818186:0:15082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787367644.818226:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367644.818233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874190446719616:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787367644.818255:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1787367644.818649:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcbf1f1bac53f4870 00000004:00100000:1.0:1787367644.818664:0:14378:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787367644.818696:0:14378:0:(import.c:65:import_set_state_nolock()) ffff9e8fbc0f0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367644.818753:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874190446719616:12345-0@lo:38:llog_process_th.0 Request processed in 519us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.818762:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787367644.818807:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8e82066d80 x1874190446719616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367644.818828:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787367644.818836:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787367644.818843:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787367644.818848:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787367644.818850:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8f918f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787367644.818857:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874190446719616:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787367644.820375:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367644.820384:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787367644.820387:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367644.820390:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787367644.820743:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446719744:0@lo:400:kworker.0 00000100:00100000:1.0:1787367644.820803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.820862:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719744 00000100:00100000:1.0:1787367644.820869:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719744 00000100:00100000:1.0:1787367644.820909:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367644.820917:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446719744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367644.820966:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446719744:12345-0@lo:400:kworker.0 Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.820973:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787367644.821006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e8fa014d880 x1874190446719744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367644.821020:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446719744:0@lo:400:kworker.0 00000040:00080000:3.0:1787367644.826883:0:15082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787367644.827131:0:15060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787367644.827167:0:15060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787367644.827186:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f485b expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.827217:0:15060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599000/0xcbf1f1bac53f4854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f485b expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787367644.828365:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787367644.828368:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367644.828370:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367644.828371:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367644.828373:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367644.828374:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367644.828376:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367644.828378:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367644.828379:0:15060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367644.828383:0:15060:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787367644.828386:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787367644.828387:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367644.828388:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367644.828389:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367644.828390:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367644.828391:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367644.828392:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367644.828393:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367644.828394:0:15060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787367644.828432:0:15060:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787367644.828453:0:15060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787367644.828535:0:15060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.828924:0:15060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc19e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787367644.828976:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446719872 00000100:00100000:2.0:1787367644.828983:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446719872 00000100:00100000:2.0:1787367644.829069:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787367644.829081:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15060:x1874190446719872:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787367644.829117:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787367644.829131:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787367644.863166:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787367644.863189:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787367644.863415:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787367644.863420:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787367644.863444:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863465:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863488:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863530:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863557:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 16 pid: 14371 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367644.863574:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446720000:0@lo:104: 00000100:00100000:1.0:1787367644.863649:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.863694:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f9a48ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787367644.863738:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720000 00000100:00100000:1.0:1787367644.863745:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720000 00000100:00100000:1.0:1787367644.863792:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367644.863801:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446720000:12345-0@lo:104: 00010000:00010000:1.0:1787367644.863814:0:14359:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863862:0:14359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367644.863868:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446720000:12345-0@lo:104: Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.863875:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787367644.863901:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367644.863908:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863915:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367644.863925:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863933:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367644.863941:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367644.863946:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367644.863972:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.863978:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367644.863998:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864005:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f47dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f47e4 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864020:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367644.864021:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367644.864023:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367644.864046:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367644.864075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367644.864106:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720128 00000100:00100000:1.0:1787367644.864109:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720128 00010000:00010000:1.0:1787367644.864124:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 17 pid: 14371 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367644.864144:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367644.864155:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:3310:x1874190446720128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367644.864166:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367644.864172:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 17 pid: 14371 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864182:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 17 pid: 14371 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864236:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864244:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367644.864271:0:14361:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002280337s 00010000:00010000:1.0:1787367644.864276:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864282:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864289:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864295:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864300:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367644.864304:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864320:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864330:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864341:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367644.864371:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:3310:x1874190446720128:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367644.864378:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787367644.864428:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367644.864454:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f47e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f47dd expref: 16 pid: 14371 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367644.864463:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446720000:0@lo:104: 00010000:00010000:1.0:1787367644.864476:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864485:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864491:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367644.864497:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f4877 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367644.882222:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+15:15060:x1874190446719872:12345-0@lo:253:mount.lustre.0 Request processed in 53113us (53657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367644.882240:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787367644.882641:0:15060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15060:1874190446719872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787367644.882671:0:15060:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787367644.882674:0:15060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787367644.882676:0:15060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787367644.882677:0:15060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787367644.882678:0:15060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787367644.882680:0:15060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787367644.882681:0:15060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787367644.882682:0:15060:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787367644.882684:0:15060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787367644.882685:0:15060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787367644.882701:0:15060:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787367644.887763:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367644.887926:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787367644.888078:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367644.888803:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787367644.888965:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787367644.889180:0:15060:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787367644.890833:0:15060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787367644.949898:0:15060:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787367644.949909:0:15060:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787367644.949945:0:15060:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787367644.950056:0:15060:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787367644.950084:0:15060:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787367644.950115:0:15060:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787367645.700424:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367646.726044:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787367646.853832:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367646.853845:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8fbaec6800 from 7 10000000:01000000:2.0:1787367646.853853:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367646.853924:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367646.853953:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367646.853968:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367646.854002:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446720256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367646.854095:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367646.854165:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367646.854455:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720256 00000100:00100000:3.0:1787367646.854465:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720256 00000100:00100000:3.0:1787367646.854545:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367646.854568:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+15:14373:x1874190446720256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367646.854604:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367646.854623:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f487e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367646.854653:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367646.854665:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367646.854674:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357e400, rc 0) 00000100:00100000:3.0:1787367646.854729:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:14373:x1874190446720256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367646.854737:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787367646.855261:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446720256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367646.855282:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367646.855295:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367646.855372:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446720384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787367646.855414:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367646.855434:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f87942000 going to sleep for 11 seconds 00000100:00100000:3.0:1787367646.855452:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720384 00000100:00100000:3.0:1787367646.855457:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720384 00000100:00100000:3.0:1787367646.855484:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787367646.855491:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:14373:x1874190446720384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787367646.855743:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787367646.855764:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787367646.855838:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787367646.855956:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:14373:x1874190446720384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 463us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367646.855965:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787367646.856138:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446720384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787367646.856283:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787367646.856292:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367646.856303:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367647.748069:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367648.773156:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367649.798606:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367649.860648:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787367649.860660:0:12621:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787367649.860664:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787367649.860668:0:12621:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787367649.860884:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367649.860919:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720512:0@lo:400:kworker.0 00000100:00100000:1.0:1787367649.861067:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367649.861187:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720512 00000100:00100000:1.0:1787367649.863096:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720512 00000100:00100000:1.0:1787367649.864593:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787367649.864619:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446720512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367649.865400:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446720640:0@lo:400:kworker.0 00000100:00100000:0.0:1787367649.872478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367649.872561:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787367649.872578:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446720768:0@lo:400:kworker.0 00000100:00100000:0.0:1787367649.872622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367649.878980:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446720512:12345-0@lo:400:kworker.0 Request processed in 14357us (17899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367649.879001:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787367649.879084:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720640 00000100:00100000:1.0:1787367649.879096:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720640 00000100:00100000:1.0:1787367649.879151:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720768 00000100:00100000:1.0:1787367649.879155:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720768 00000100:00100000:1.0:1787367649.879229:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367649.879241:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446720640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367649.879418:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720512:0@lo:400:kworker.0 00000100:00100000:1.0:1787367649.880539:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446720640:12345-0@lo:400:kworker.0 Request processed in 1293us (8065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367649.880551:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367649.880586:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367649.880597:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446720768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367649.880633:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446720768:12345-0@lo:400:kworker.0 Request processed in 40us (8009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367649.880640:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787367649.881428:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8e8340f480 x1874190446720768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367649.881460:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446720768:0@lo:400:kworker.0 00010000:00080000:0.0:1787367649.881477:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8e8340ed80 x1874190446720640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787367649.881496:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446720640:0@lo:400:kworker.0 00000100:00080000:1.0:1787367649.881659:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787367650.820868:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787367651.207250:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367651.854946:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787367652.068126:0:15427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787367652.867359:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367653.896364:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367654.019286:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367639/real 1787367639] req@ffff9e8e8340e300 x1874190446716288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367654 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367654.019319:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e8e8340e300 x1874190446716288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367654 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367654.019329:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787367639/real 1787367639] req@ffff9e8e8340f100 x1874190446716416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367654 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367654.019340:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e8e8340f100 x1874190446716416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787367654 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787367654.019428:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8e81d4a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367654.019915:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787367654.019921:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446716288:0@lo:8:kworker.0 00000100:00080000:3.0:1787367654.019927:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787367654.020532:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367654.020536:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787367654.020539:0:475:0:(import.c:65:import_set_state_nolock()) ffff9e8e81d4a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367654.020544:0:475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1787367654.020560:0:475:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787367654.020567:0:475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e8e81d4a000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367654.020590:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fa014f480 x1874190446721024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787367654.020600:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367654.020603:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787367654.020605:0:475:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367654.020609:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1787367654.020611:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787367654.020614:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367654.020625:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fa014c700 x1874190446721152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367654.020674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720896:0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.020741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367654.020793:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367654.020799:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446721280:0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.020825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367654.020854:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446721408:0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.020876:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367654.020926:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446720896 00000100:00100000:1.0:1787367654.020933:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446720896 00000100:00100000:1.0:1787367654.020976:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367654.020985:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.021033:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446720896:12345-0@lo:400:kworker.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367654.021050:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787367654.021086:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721280 00000100:00100000:1.0:1787367654.021090:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721280 00000100:00100000:1.0:1787367654.021113:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721408 00000100:00100000:1.0:1787367654.021116:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721408 00000100:00100000:1.0:1787367654.021140:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367654.021146:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446721280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.021177:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446721280:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367654.021184:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787367654.021226:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787367654.021233:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446721408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.021263:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446721408:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367654.021268:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787367654.021294:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787367654.021319:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fa014fb80 x1874190446721408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367654.021331:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446721408:0@lo:400:kworker.0 00000100:00080000:3.0:1787367654.021853:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787367654.021860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446716416:0@lo:8:kworker.0 00000100:00100000:3.0:1787367654.021885:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446721024:0@lo:8:kworker.0 00000100:00100000:3.0:1787367654.022298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367654.022377:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446721152:0@lo:8:kworker.0 00000100:00100000:3.0:1787367654.022419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787367654.022465:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fa014e680 x1874190446721280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787367654.022481:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446721280:0@lo:400:kworker.0 00000100:00100000:1.0:1787367654.022501:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446720896:0@lo:400:kworker.0 00000100:00100000:2.0:1787367654.022840:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721024 00000100:00100000:2.0:1787367654.022847:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721024 00000100:00100000:1.0:1787367654.022998:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721152 00000100:00100000:1.0:1787367654.023008:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721152 00000100:00100000:1.0:1787367654.025157:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367654.025171:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874190446721024:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787367654.025238:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1787367654.025273:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f488c 00002000:00100000:1.0:1787367654.025289:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e8fbc0f1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787367654.025294:0:15063:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787367654.025297:0:15063:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787367654.025648:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787367654.025675:0:15063:0:(import.c:65:import_set_state_nolock()) ffff9e8fbc0f3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367654.025763:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874190446721024:12345-0@lo:8:kworker.0 Request processed in 593us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367654.025770:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787367654.025790:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787367654.025794:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874190446721152:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787367654.025805:0:15063:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787367654.025833:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874190446721152:12345-0@lo:8:kworker.0 Request processed in 37us (3413us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787367654.025839:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787367654.028142:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8fa014f480 x1874190446721024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367654.028161:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367654.028171:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787367654.028207:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787367654.028215:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787367654.028233:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8e81d4a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787367654.028262:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787367654.028270:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446721024:0@lo:8:kworker.0 00000100:00080000:3.0:1787367654.028287:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787367654.028292:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787367654.028294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446721152:0@lo:8:kworker.0 00000004:00080000:3.0:1787367654.028379:0:14400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787367654.028407:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874190446721664:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787367654.028467:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367654.028501:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f90176840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367654.028520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367654.028546:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367654.028593:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721536 00000100:00100000:3.0:1787367654.028602:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721664 00000100:00100000:0.0:1787367654.028602:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721536 00000100:00100000:3.0:1787367654.028608:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721664 00000100:00100000:0.0:1787367654.028666:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787367654.028762:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787367654.031592:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446721536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787367654.031636:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367654.031734:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874190446721536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3058us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367654.031743:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787367654.033169:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459308973424ns, next at 0ns, rc = 0 00000100:00080000:1.0:1787367654.041707:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787367654.044149:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8e82065c00 x1874190446721536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367654.044179:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446721536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367654.044291:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367654.044315:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14400:x1874190446721664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787367654.059507:0:15064:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787367654.059519:0:15064:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787367654.059525:0:15064:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787367654.087336:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.087353:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.087503:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.087507:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.087514:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.087533:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.087545:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.087553:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.087579:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367654.088086:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.088092:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.088113:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.088116:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.088120:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.088129:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.088138:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.088144:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.088163:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787367654.088755:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367654.088766:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088776:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.088781:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088801:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088822:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088832:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4893 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088855:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367654.088860:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088867:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.088871:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088879:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088890:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088898:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f489a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.088940:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.088942:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.088944:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.092866:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.092880:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.092895:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.092900:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367654.093165:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.095495:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.095524:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.095552:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.095559:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.095586:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367654.096234:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.096241:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096254:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.096258:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.096264:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096274:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096282:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096288:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096317:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787367654.096334:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367654.096341:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.096349:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fc00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.096354:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.097602:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.098183:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.098245:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.098254:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.098278:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.098281:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.098283:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.100068:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.100079:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.100097:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.100110:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.100118:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.100136:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.100145:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.100152:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.100182:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367654.102426:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367654.102441:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.102454:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.102460:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.102471:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.102498:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.102505:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f48af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.102530:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.102533:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.102534:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.104135:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.104146:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104162:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.104166:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.104173:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104187:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104240:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104255:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104278:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367654.104825:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.104832:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104841:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.104845:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.104849:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104858:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104866:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104872:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.104879:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787367654.106123:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367654.106135:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106154:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.106158:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106167:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106187:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106211:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106241:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367654.106245:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106251:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fa00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.106255:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106262:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106272:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106284:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.106298:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.106300:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.106302:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.109676:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.109688:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109712:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.109717:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.109724:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109738:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109748:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109755:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109780:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.109796:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.109801:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109809:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.109814:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109822:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109851:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109858:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.109876:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.109878:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.109880:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.118935:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.118947:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.118965:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.118970:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.118977:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.118991:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119002:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119011:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119046:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.119060:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.119066:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119073:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.119077:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119087:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119105:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119112:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f48cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119129:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.119131:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.119133:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.119611:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.119618:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119627:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.119636:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.119641:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119651:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119659:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119666:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119680:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.119688:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.119692:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119699:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.119702:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119708:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119718:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119736:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f48d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.119750:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.119752:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.119754:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.120146:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.120152:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120161:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.120165:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.120169:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120177:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120184:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120227:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120244:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.120252:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.120262:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120270:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fc00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.120273:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120281:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120294:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120301:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f48d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120314:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.120316:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.120318:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.120727:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.120734:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120742:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.120745:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.120750:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120771:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120780:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120788:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120805:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.120814:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.120818:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120825:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.120828:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120835:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120847:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120854:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f48e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.120875:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.120877:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.120878:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.124283:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.124302:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124322:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.124327:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.124337:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124356:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124369:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124377:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124398:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.124413:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.124419:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124443:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.124448:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124459:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124478:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124485:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f48e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.124504:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.124507:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.124509:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.125796:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.125879:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125892:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.125896:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.125902:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125914:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125931:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125939:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125956:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.125984:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.125990:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.125998:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.126001:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126010:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126023:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126030:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f48ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126047:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.126054:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.126056:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.126897:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.126906:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126917:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.126921:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.126926:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126935:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126943:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126950:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.126972:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367654.127653:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367654.127662:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.127673:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fa00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.127679:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.127687:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.127706:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.127712:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f48f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.127733:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.127735:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.127736:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.127986:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.127994:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.128005:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.128008:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.128014:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.128032:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.128041:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.128050:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.128074:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367654.128251:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367654.128259:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.128267:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367654.128271:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.128279:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.128296:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.128304:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f48fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.128334:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367654.128336:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367654.128338:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.129224:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.129235:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.129248:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.129251:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.129258:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.129270:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.129280:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.129301:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.129322:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367654.129623:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367654.129631:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129640:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.129644:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129652:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129669:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129677:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129695:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.129697:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.129698:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.129755:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.129758:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.129760:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.129806:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129815:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fe00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367654.129818:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129839:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129852:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129859:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d2a66ab/0xcbf1f1bac53f48a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367654.129874:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.129876:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.129878:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.130032:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.130040:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130050:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.130055:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.130060:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130071:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130079:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130087:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130103:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367654.130111:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367654.130116:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130128:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367654.130264:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130273:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130285:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130293:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f490a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.130306:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.130309:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.130311:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.131046:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.131054:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131064:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.131068:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.131073:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131083:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131098:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131106:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131123:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367654.131936:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.131944:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131956:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.131960:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.131964:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131975:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131985:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.131993:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.132028:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787367654.132829:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367654.133001:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133015:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.133019:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133030:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133051:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133060:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bac35b5/0xcbf1f1bac53f4911 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133126:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.133131:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133138:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fc00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.133141:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133149:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133172:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133180:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba84d98/0xcbf1f1bac53f4918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.133225:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.133228:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.133230:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367654.134097:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787367654.135234:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787367654.136290:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.136304:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.136321:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.136327:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.136333:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.136350:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.136362:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.136371:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.136398:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367654.138431:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.138448:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.138466:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.138471:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.138481:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.138507:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.138515:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e109e4c0/0xcbf1f1bac53f491f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.138559:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.138561:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.138563:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.139607:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.139623:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.139640:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.139656:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.139663:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.139679:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.139689:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.139697:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.139723:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367654.141124:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.141136:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.141148:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.141152:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.141164:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.141184:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.141206:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c364373/0xcbf1f1bac53f4926 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.141237:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.141239:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.141241:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.141451:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.141459:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.141471:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.141475:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.141482:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.141493:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.141502:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.141517:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.141673:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367654.141985:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367654.141993:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.142002:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367654.142006:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.142014:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.142029:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.142037:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125256af/0xcbf1f1bac53f492d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.142055:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367654.142058:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367654.142060:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.142240:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.142247:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142255:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.142259:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.142263:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142273:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142281:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142289:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142311:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367654.142438:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.142445:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.142467:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.142472:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.142481:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.142492:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.142499:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4934 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.142514:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.142516:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.142518:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.142777:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.142783:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142866:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.142871:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.142876:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142886:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142893:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142899:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.142955:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367654.143419:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.143426:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.143435:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.143438:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.143442:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.143451:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.143473:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.143481:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143593:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367654.143600:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143608:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.143612:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143621:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143642:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143649:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002110c4a1/0xcbf1f1bac53f493b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143665:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.143668:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143675:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.143678:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143686:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143696:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.143705:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.143707:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.143708:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367654.143747:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787367654.143753:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac77c1a/0xcbf1f1bac53f4942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367654.143843:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367654.144568:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367654.144576:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.144589:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787367654.144592:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367654.144597:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.144607:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.144615:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.144635:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367654.144704:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787367654.144928:0:15064:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1787367654.145047:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14400:x1874190446721664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100732us (116576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367654.145058:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787367654.145175:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874190446721664:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787367654.145234:0:14400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787367654.145293:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874190446721792:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787367654.145332:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367654.145388:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367654.145544:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721792 00000100:00100000:3.0:1787367654.145551:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721792 00000100:00100000:3.0:1787367654.145599:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367654.145610:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14400:x1874190446721792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787367654.145661:0:15061:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787367654.149027:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367654.149039:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.149065:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367654.149070:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.149081:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.149103:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.149111:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000732bd46/0xcbf1f1bac53f4949 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367654.149132:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.149134:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367654.149136:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367654.152600:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14400:x1874190446721792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6983us (7258us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787367654.152615:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787367654.156344:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1874190446721792:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787367654.156368:0:14400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787367654.922107:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787367655.642164:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787367655.642221:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1787367655.939459:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367656.963443:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367657.990148:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367659.011597:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367659.075445:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446721920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367659.075525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787367659.075541:0:12621:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787367659.075546:0:12621:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787367659.075550:0:12621:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787367659.075555:0:12621:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1787367659.075560:0:12621:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787367659.075567:0:12621:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367659.075583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367659.075589:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446722048:0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.075590:0:12621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e82065f80 x1874190446722304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367659.075615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.075627:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787367659.075634:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446722560:0@lo:400:kworker.0 00000100:00100000:1.0:1787367659.075665:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446721920 00000100:00100000:3.0:1787367659.075670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.075672:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446721920 00000100:00100000:3.0:1787367659.075699:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446722432:0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.075719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.075728:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367659.075736:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787367659.075736:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446721920:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367659.075740:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446722176:0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.075762:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787367659.075779:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367659.075782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446722304:0@lo:8:kworker.0 00000100:00100000:3.0:1787367659.075802:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.075818:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446721920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367659.075825:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787367659.075827:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722560 00000100:00100000:3.0:1787367659.075831:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722560 00000100:00100000:1.0:1787367659.075846:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722048 00000100:00100000:1.0:1787367659.075849:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722048 00000100:00100000:3.0:1787367659.075857:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722432 00000100:00100000:3.0:1787367659.075860:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722432 00000100:00100000:1.0:1787367659.075869:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787367659.075872:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367659.075875:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446722048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.075877:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446722560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.075904:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446722560:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367659.075904:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446722048:12345-0@lo:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.075911:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787367659.075911:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787367659.075923:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367659.075929:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446722432:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787367659.075934:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787367659.075938:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367659.075955:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874190446722432:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.075960:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787367659.075964:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446722048:0@lo:400:kworker.0 00000100:00100000:1.0:1787367659.075975:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787367659.075977:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722176 00000100:00100000:3.0:1787367659.075994:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722176 00000100:00100000:1.0:1787367659.075995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446721920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367659.076016:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722304 00000100:00100000:3.0:1787367659.076019:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722304 00000100:00100000:3.0:1787367659.076029:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367659.076042:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446722176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.076071:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446722176:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.076076:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367659.076087:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787367659.076090:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874190446722304:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787367659.076104:0:15064:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787367659.078305:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8e82064e00 x1874190446722560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367659.078326:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446722560:0@lo:400:kworker.0 00000100:00100000:2.0:1787367659.080384:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446722176:0@lo:400:kworker.0 00010000:00080000:2.0:1787367659.080419:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e8e82067800 x1874190446722432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367659.080440:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874190446722432:0@lo:400:kworker.0 00000100:00100000:3.0:1787367659.105634:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874190446722304:12345-0@lo:8:kworker.0 Request processed in 29533us (29822us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787367659.105650:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787367659.107450:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787367659.107464:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787367659.107469:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446722304:0@lo:8:kworker.0 00000020:01000004:3.0:1787367659.744062:0:15781:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787367659.744067:0:15781:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787367659.744231:0:15781:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e8f918f1000 00000020:01000004:1.0:1787367659.744280:0:15781:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787367659.744294:0:15781:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787367659.744309:0:15781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e8fafce8000) 00000020:00000080:1.0:1787367659.744329:0:15781:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787367659.783936:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787367659.785647:0:15781:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787367659.789869:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787367659.790135:0:15781:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787367659.790851:0:15781:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787367659.791398:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 645: rc = 0 00100000:10000000:3.0:1787367659.791515:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 645: rc = 0 00100000:10000000:3.0:1787367659.791599:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 645: rc = 0 00100000:10000000:3.0:1787367659.793029:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 417: rc = 0 00100000:10000000:3.0:1787367659.798996:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 417: rc = 0 00100000:10000000:3.0:1787367659.800789:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 417: rc = 0 00100000:10000000:3.0:1787367659.801063:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 417: rc = 0 00100000:10000000:3.0:1787367659.802441:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 417: rc = 0 00100000:10000000:3.0:1787367659.802703:0:15781:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 417: rc = 0 00000020:00000080:3.0:1787367659.803392:0:15781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787367659.803410:0:15781:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787367659.803421:0:15781:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbf1f1bac53f4957 00000020:01000004:3.0:1787367659.803429:0:15781:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787367659.803451:0:15781:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787367659.803455:0:15781:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787367659.803461:0:15781:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787367659.803486:0:15781:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787367659.803490:0:15781:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787367659.822026:0:15781:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787367659.822410:0:15781:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.123@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787367659.822414:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787367659.822416:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787367659.822417:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367659.822418:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367659.822420:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367659.822421:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367659.822422:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367659.822424:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367659.822425:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787367659.822429:0:15781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787367659.822431:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787367659.822432:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787367659.822433:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367659.822434:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367659.822435:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367659.822436:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367659.822437:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367659.822438:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367659.822439:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787367659.822480:0:15781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787367659.822507:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787367659.822582:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367659.822699:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc19ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787367659.823426:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722688 00000100:00100000:1.0:1787367659.823437:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722688 00000100:00100000:1.0:1787367659.823590:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787367659.823602:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15781:x1874190446722688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787367659.823636:0:14369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787367659.823640:0:14369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787367659.823654:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787367659.834996:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15781:x1874190446722688:12345-0@lo:253:mount.lustre.0 Request processed in 11386us (12404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367659.835014:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787367659.835240:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787367659.835265:0:15781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787367659.835269:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787367659.835271:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787367659.835272:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787367659.835273:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787367659.835275:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787367659.835276:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787367659.835277:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787367659.835279:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787367659.835280:0:15781:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787367659.835302:0:15781:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e8f918f1000 from lustre-OST0001 10000000:01000000:2.0:1787367659.835329:0:15781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787367659.835332:0:15781:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787367659.835341:0:15781:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e8fbf643370 local copy 00010000:00010000:2.0:1787367659.835353:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367659.835622:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367659.835663:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367659.835706:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc19e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367659.836096:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722816 00000100:00100000:3.0:1787367659.836113:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722816 00000100:00100000:3.0:1787367659.836158:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787367659.836167:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15781:x1874190446722816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367659.836449:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15781:x1874190446722816:12345-0@lo:501:mount.lustre.0 Request processed in 283us (785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787367659.836457:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787367659.836600:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722816:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787367659.836617:0:15781:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787367659.836790:0:15781:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787367659.836798:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.836808:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75400/0xcbf1f1bac53f4704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f470b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367659.836835:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e8f918f1000 10000000:01000000:0.0:1787367659.836840:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787367659.836844:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787367659.836847:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787367659.836851:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787367659.836854:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787367659.836878:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.836886:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.836906:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367659.836921:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787367659.836950:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367659.836975:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446722944 00000100:00100000:0.0:1787367659.836978:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446722944 00000100:00100000:0.0:1787367659.836999:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787367659.837005:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:15781:x1874190446722944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367659.837014:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367659.837025:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598400/0xcbf1f1bac53f4965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f495e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.837046:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598400/0xcbf1f1bac53f4965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f495e expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.837057:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598400/0xcbf1f1bac53f4965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f495e expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.837064:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598400, rc 0) 00000100:00100000:0.0:1787367659.837088:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446722944:12345-0@lo:101:mount.lustre.0 Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367659.837094:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787367659.837135:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367659.837149:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446722944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787367659.837159:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4965 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367659.837176:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4965 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367659.837810:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787367659.838722:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787367659.838960:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787367659.839005:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787367659.839033:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787367659.839078:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787367659.839128:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787367659.839160:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787367659.839252:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787367659.839260:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787367659.839333:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787367659.839392:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.845549:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723072 00000100:00100000:3.0:1787367659.845576:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723072 00000100:00100000:3.0:1787367659.845631:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787367659.845641:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367659.846180:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723072:12345-0@lo:501:mount.lustre.0 Request processed in 539us (6786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.846188:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787367659.850734:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.850787:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367659.850862:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787367659.850966:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367659.851014:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc19eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367659.851253:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723200 00000100:00100000:3.0:1787367659.851260:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723200 00000100:00100000:3.0:1787367659.851310:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787367659.851319:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787367659.851716:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723200:12345-0@lo:503:mount.lustre.0 Request processed in 396us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.851736:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787367659.852711:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787367659.854372:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787367659.854473:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367659.854583:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.854638:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.855087:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723328 00000100:00100000:2.0:1787367659.855120:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723328 00000100:00100000:2.0:1787367659.855173:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787367659.855182:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787367659.855473:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723328:12345-0@lo:502:mount.lustre.0 Request processed in 291us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367659.855482:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787367659.855825:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367659.856079:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787367659.856151:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787367659.856188:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787367659.856300:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787367659.856340:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787367659.856375:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787367659.856442:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787367659.856483:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787367659.856547:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787367659.856602:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367659.856668:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.856703:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367659.857066:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723456 00000100:00100000:0.0:1787367659.857073:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723456 00000100:00100000:0.0:1787367659.857126:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787367659.857135:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367659.857362:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723456:12345-0@lo:502:mount.lustre.0 Request processed in 227us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367659.857370:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787367659.857960:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367659.858072:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787367659.858087:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787367659.860121:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787367659.860133:0:15782:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787367659.860141:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.860143:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787367659.860151:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787367659.860259:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e8fb5668000) 00000020:00000080:2.0:1787367659.860286:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787367659.860296:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787367659.860376:0:15782:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8f918f1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787367659.860383:0:15782:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787367659.860391:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcbf1f1bac53f4973 00010000:00010000:2.0:1787367659.871941:0:15782:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787367659.873901:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787367659.885996:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787367659.893626:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787367659.893645:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367659.893655:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367659.893658:0:15782:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787367659.893663:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367659.893667:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367659.893668:0:15782:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787367659.893671:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787367659.893673:0:15782:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787367659.893676:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367659.893678:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367659.893679:0:15782:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787367659.893681:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787367659.893683:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367659.893685:0:15782:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787367659.893696:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787367659.893770:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787367659.893772:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787367659.893773:0:15782:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787367659.893776:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787367659.894062:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787367659.894097:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787367659.894134:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4965 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.894145:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fbf599800/0xcbf1f1bac53f495e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4965 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367659.894154:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f918f1000 from 1 10000000:01000000:3.0:1787367659.894156:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367659.894231:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.894556:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.894578:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367659.894603:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787367659.894679:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.894741:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.894855:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723584 00000100:00100000:2.0:1787367659.894864:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723584 00000100:00100000:2.0:1787367659.894920:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787367659.894930:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:15781:x1874190446723584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367659.894945:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367659.894959:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f497a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.894982:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.895002:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.895010:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a74e00, rc 0) 00000100:00100000:2.0:1787367659.895062:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723584:12345-0@lo:101:mount.lustre.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367659.895069:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787367659.895626:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787367659.895643:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.895654:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787367659.899563:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787367659.900178:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787367659.901742:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787367659.901798:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787367659.901863:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787367659.901872:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787367659.901970:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367659.902038:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.902076:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.904600:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723712 00000100:00100000:2.0:1787367659.904612:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723712 00000100:00100000:2.0:1787367659.904668:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787367659.904678:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367659.904987:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723712:12345-0@lo:501:mount.lustre.0 Request processed in 309us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367659.904995:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787367659.905502:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787367659.905568:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787367659.905624:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.905654:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723840 00000100:00100000:3.0:1787367659.905659:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723840 00000100:00100000:3.0:1787367659.905702:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787367659.905710:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787367659.906889:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787367659.908669:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723840:12345-0@lo:503:mount.lustre.0 Request processed in 2950us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367659.908871:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787367659.909947:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787367659.910031:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367659.910349:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787367659.911889:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367659.911942:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367659.912951:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446723968 00000100:00100000:3.0:1787367659.912961:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446723968 00000100:00100000:3.0:1787367659.913021:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787367659.913033:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367659.914140:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446723968:12345-0@lo:502:mount.lustre.0 Request processed in 1105us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.914151:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787367659.914934:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446723968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787367659.915315:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787367659.915377:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787367659.915427:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787367659.915476:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787367659.915511:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787367659.915574:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787367659.915612:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787367659.915644:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787367659.916173:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367659.916452:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367659.916536:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.927847:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724096 00000100:00100000:2.0:1787367659.927865:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724096 00000100:00100000:3.0:1787367659.932363:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787367659.932378:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446724096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367659.932694:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446724096:12345-0@lo:502:mount.lustre.0 Request processed in 311us (16245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.932703:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787367659.933089:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787367659.933294:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787367659.933310:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787367659.935278:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367659.935293:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.935295:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787367659.935304:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f918f1000 00000020:00000080:2.0:1787367659.935306:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787367659.935314:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367659.935316:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.935317:0:15786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787367659.935319:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367659.935321:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.935322:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787367659.935325:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e8f918f1000 00000020:00000080:2.0:1787367659.935327:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787367659.935392:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367659.935396:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.935397:0:15786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787367659.935400:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787367659.935403:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.935404:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787367659.935407:0:15786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e8f918f1000 00000020:00000080:2.0:1787367659.935409:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787367659.937350:0:15786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787367659.937360:0:15786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787367659.937362:0:15786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787367659.937368:0:15786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787367659.939371:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787367659.939425:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367659.939456:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.939471:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367659.939541:0:15781:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787367659.939544:0:15781:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e8f918f1000 10000000:01000000:3.0:1787367659.939548:0:15781:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e8f918f1000 10000000:01000000:3.0:1787367659.939552:0:15781:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787367659.939568:0:15781:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e8f918f1000 from 1 10000000:01000000:3.0:1787367659.939571:0:15781:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787367659.939610:0:15781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.939618:0:15781:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367659.939629:0:15781:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367659.939655:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787367659.939864:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367659.939909:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.940896:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724224 00000100:00100000:2.0:1787367659.940906:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724224 00000100:00100000:2.0:1787367659.940960:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787367659.940969:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446724224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787367659.940984:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367659.940999:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb2a75800/0xcbf1f1bac53f498f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4988 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.941023:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb2a75800/0xcbf1f1bac53f498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4988 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.941034:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb2a75800/0xcbf1f1bac53f498f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4988 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367659.941043:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb2a75800, rc 0) 00000100:00100000:2.0:1787367659.941129:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724224:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367659.941137:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787367659.941713:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787367659.941732:0:15781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f498f expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367659.941742:0:15781:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f498f expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367659.942459:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787367659.946998:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787367659.947319:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787367659.947358:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787367659.947385:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787367659.947421:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787367659.947451:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787367659.947514:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787367659.947542:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787367659.947567:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787367659.947602:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787367659.947629:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787367659.947655:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787367659.947690:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787367659.947717:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787367659.947743:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787367659.947782:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787367659.947809:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787367659.947834:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787367659.947870:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787367659.947897:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787367659.947923:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787367659.947959:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787367659.948001:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787367659.948028:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787367659.948069:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787367659.948099:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787367659.948143:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787367659.948182:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787367659.948238:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787367659.948266:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787367659.948315:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787367659.948344:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787367659.948371:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787367659.948398:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787367659.948433:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787367659.948461:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787367659.953458:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787367659.953569:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787367659.953889:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787367659.953899:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787367659.954021:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367659.954110:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.963921:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367659.964391:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724352 00000100:00100000:2.0:1787367659.964409:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724352 00000100:00100000:2.0:1787367659.964464:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787367659.964474:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787367659.965905:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724352:12345-0@lo:501:mount.lustre.0 Request processed in 1426us (11798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367659.965916:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787367659.975305:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787367659.975374:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787367659.975472:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367659.975532:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367659.976066:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724480 00000100:00100000:3.0:1787367659.976074:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724480 00000100:00100000:3.0:1787367659.980598:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787367659.980625:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787367659.981005:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724480:12345-0@lo:503:mount.lustre.0 Request processed in 393us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367659.981013:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787367659.991432:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787367659.993976:0:15781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787367659.994081:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367659.994189:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367659.995854:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724608 00000100:00100000:0.0:1787367659.995868:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724608 00000100:00100000:0.0:1787367659.995927:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787367659.995937:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787367660.003072:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787367660.008739:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724608:12345-0@lo:502:mount.lustre.0 Request processed in 12795us (14542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367660.008754:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787367660.015063:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367660.015996:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787367660.016078:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787367660.016434:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787367660.016530:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787367660.016780:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787367660.016857:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787367660.016896:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787367660.016927:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787367660.016970:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787367660.017000:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787367660.017025:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787367660.017684:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787367660.017735:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787367660.017770:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787367660.017817:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787367660.017852:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787367660.017882:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787367660.017929:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787367660.017965:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787367660.018020:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787367660.018085:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787367660.022931:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787367660.022986:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787367660.023083:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787367660.023548:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787367660.023667:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787367660.023723:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787367660.023761:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787367660.023796:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787367660.023845:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787367660.023883:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787367660.023916:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787367660.023952:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787367660.024001:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787367660.024036:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787367660.027714:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787367660.027789:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787367660.027818:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787367660.027858:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787367660.027888:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787367660.027950:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787367660.028038:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367660.029841:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787367660.035730:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724736 00000100:00100000:0.0:1787367660.035746:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724736 00000100:00100000:0.0:1787367660.035955:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787367660.035966:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787367660.036475:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446724736:12345-0@lo:502:mount.lustre.0 Request processed in 508us (8434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367660.036485:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787367660.036614:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446724736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787367660.038813:0:15781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787367660.038833:0:15781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787367660.040385:0:15791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787367660.040401:0:15791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e8fbc0e19b8) 00000020:00000080:0.0:1787367660.040426:0:15791:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787367660.040530:0:15791:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e8f918f1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787367660.040534:0:15791:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e8f918f1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787367660.040537:0:15791:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e8f918f1000 3 00010000:00080000:0.0:1787367660.040577:0:15791:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e8fbb1a7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1787367660.042782:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367660.043731:0:15791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787367660.043987:0:15791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787367660.044032:0:15791:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787367660.044044:0:15791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcbf1f1bac53f499d 00000100:00080000:3.0:1787367660.044067:0:15791:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787367660.044074:0:15791:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e8fbb1a7800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1787367660.046273:0:15791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e82064380 x1874190446724864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787367660.046313:0:15791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787367660.046509:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446724864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787367660.046596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787367660.047163:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787367660.047168:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787367660.047172:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787367660.047178:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1787367660.047182:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787367660.047254:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1787367660.047276:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8fa014ed80 x1874190446725120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787367660.047331:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787367660.047341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446724992:0@lo:400:kworker.0 00000100:00100000:1.0:1787367660.047385:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367660.047892:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724864 00000100:00100000:3.0:1787367660.047900:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724864 00000100:00100000:3.0:1787367660.047946:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367660.047953:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874190446724864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787367660.047981:0:14376:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1787367660.048024:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcbf1f1bac53f49a4 00000004:00100000:3.0:1787367660.048041:0:14376:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787367660.048082:0:14376:0:(import.c:65:import_set_state_nolock()) ffff9e8f88f6c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367660.048164:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874190446724864:12345-0@lo:38:llog_process_th.0 Request processed in 210us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367660.048171:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367660.048251:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446725248:0@lo:400:kworker.0 00000100:00100000:3.0:1787367660.048283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367660.048303:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787367660.048309:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446725376:0@lo:400:kworker.0 00000100:00100000:3.0:1787367660.048331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367660.048358:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446725120:0@lo:8:kworker.0 00000100:00100000:3.0:1787367660.048384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787367660.048420:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e82064380 x1874190446724864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787367670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367660.048430:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787367660.048438:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787367660.048445:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787367660.048450:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787367660.048452:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787367660.048458:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874190446724864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787367660.048596:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725248 00000100:00100000:3.0:1787367660.048601:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725248 00000100:00100000:3.0:1787367660.048624:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725376 00000100:00100000:3.0:1787367660.048627:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725376 00000100:00100000:3.0:1787367660.048642:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367660.048648:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446725248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367660.048688:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446725248:12345-0@lo:400:kworker.0 Request processed in 40us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367660.048703:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787367660.048716:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787367660.048721:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446725376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367660.048764:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446725376:12345-0@lo:400:kworker.0 Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367660.048769:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787367660.048794:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014ca80 x1874190446725376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367660.048803:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446725376:0@lo:400:kworker.0 00010000:00080000:3.0:1787367660.048813:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014f100 x1874190446725248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367660.048819:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446725248:0@lo:400:kworker.0 00000100:00100000:2.0:1787367660.050211:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446724992 00000100:00100000:2.0:1787367660.050223:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446724992 00000100:00100000:2.0:1787367660.050273:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725120 00000100:00100000:2.0:1787367660.050276:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725120 00000100:00100000:2.0:1787367660.050292:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367660.050300:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446724992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367660.050376:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446724992:12345-0@lo:400:kworker.0 Request processed in 76us (2990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367660.050383:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367660.050401:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367660.050405:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874190446725120:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787367660.050456:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874190446725120:12345-0@lo:8:kworker.0 Request processed in 49us (2071us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787367660.050463:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367660.050494:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787367660.050502:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787367660.050505:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787367660.050521:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446725120:0@lo:8:kworker.0 00000040:00080000:3.0:1787367660.051466:0:15791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787367660.051520:0:15781:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787367660.051548:0:15781:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787367660.051576:0:15781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f498f expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367660.051588:0:15781:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e000/0xcbf1f1bac53f4988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f498f expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787367660.051633:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787367660.051635:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367660.051636:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367660.051638:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367660.051639:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367660.051645:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367660.051646:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367660.051648:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367660.051649:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367660.051652:0:15781:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787367660.051655:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787367660.051656:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367660.051657:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367660.051658:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367660.051659:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367660.051659:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367660.051660:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367660.051661:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367660.051662:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787367660.051686:0:15781:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787367660.051704:0:15781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446725504:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787367660.051757:0:15781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367660.051796:0:15781:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbf454840 going to sleep for 11 seconds 00000100:00100000:1.0:1787367660.052272:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446724992:0@lo:400:kworker.0 00000100:00100000:0.0:1787367660.053752:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725504 00000100:00100000:0.0:1787367660.053763:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725504 00000100:00100000:0.0:1787367660.053824:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787367660.053835:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:15781:x1874190446725504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787367660.053866:0:14370:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787367660.053879:0:14370:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787367660.111924:0:14370:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787367660.111946:0:14370:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787367660.112041:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787367660.112047:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787367660.112073:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112093:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112118:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112163:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112179:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 19 pid: 14369 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367660.112217:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446725632:0@lo:104: 00000100:00100000:1.0:1787367660.112295:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367660.112335:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f850b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787367660.112359:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725632 00000100:00100000:1.0:1787367660.112366:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725632 00000100:00100000:1.0:1787367660.112433:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367660.112442:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446725632:12345-0@lo:104: 00010000:00010000:1.0:1787367660.112455:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112510:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787367660.112516:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:14393:x1874190446725632:12345-0@lo:104: Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367660.112523:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787367660.112549:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367660.112776:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112786:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:1.0:1787367660.112790:0:15518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112798:0:15518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787367660.112805:0:15518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787367660.112810:0:15518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787367660.112843:0:15518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112849:0:15518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787367660.112869:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112886:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74000/0xcbf1f1bac53f487e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4885 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.112902:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367660.112905:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367660.112906:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367660.112925:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446725760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367660.112954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367660.113066:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725760 00000100:00100000:1.0:1787367660.113070:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725760 00010000:00010000:1.0:1787367660.113088:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 20 pid: 14369 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367660.113346:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787367660.113354:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+20:3310:x1874190446725760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367660.113366:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367660.113371:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 20 pid: 14369 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113381:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 20 pid: 14369 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113398:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113406:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787367660.113912:0:14361:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002280337s 00010000:00010000:1.0:1787367660.113926:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113935:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113941:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113947:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.113953:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367660.113957:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.114041:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.114052:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.114064:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787367660.114226:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+20:3310:x1874190446725760:12345-0@lo:103:ldlm_bl.0 Request processed in 872us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367660.114236:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787367660.114418:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e400/0xcbf1f1bac53f4885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f487e expref: 19 pid: 14369 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367660.114505:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1874190446725632:0@lo:104: 00010000:00010000:1.0:1787367660.114526:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.114542:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367660.114549:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367660.114679:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446725760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367660.114780:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f82b5f200/0xcbf1f1bac53f49ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367660.129845:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:15781:x1874190446725504:12345-0@lo:253:mount.lustre.0 Request processed in 76002us (78076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367660.129859:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787367660.130179:0:15781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74b4a5c6-75ad-491b-a27a-c62858f32053:15781:1874190446725504:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787367660.130215:0:15781:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787367660.130219:0:15781:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787367660.130220:0:15781:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787367660.130222:0:15781:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787367660.130223:0:15781:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787367660.130224:0:15781:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787367660.130226:0:15781:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787367660.130227:0:15781:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787367660.130229:0:15781:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787367660.130230:0:15781:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787367660.130302:0:15781:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787367660.138354:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367660.138759:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787367660.138928:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367660.139702:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787367660.139865:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787367660.140699:0:15781:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787367660.143188:0:15781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787367660.239625:0:15781:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787367660.239636:0:15781:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787367660.239690:0:15781:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787367660.239771:0:15781:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787367660.239798:0:15781:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787367660.239828:0:15781:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787367661.059593:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787367661.389488:0:14373:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787367661.389499:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e8fbaec6800 from 8 10000000:01000000:2.0:1787367661.389506:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787367661.389561:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367661.389574:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367661.389586:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367661.389613:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446725888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787367661.389684:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367661.389740:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc0d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787367661.389920:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446725888 00000100:00100000:0.0:1787367661.389928:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446725888 00000100:00100000:0.0:1787367661.389986:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787367661.389995:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446725888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367661.390008:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367661.390022:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598200/0xcbf1f1bac53f49b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f49b2 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367661.390047:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598200/0xcbf1f1bac53f49b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f49b2 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367661.390068:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598200/0xcbf1f1bac53f49b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f49b2 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367661.390090:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598200, rc 0) 00000100:00100000:0.0:1787367661.390143:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446725888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367661.390151:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787367661.390270:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446725888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367661.390303:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f49b9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367661.390312:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f49b9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367661.390368:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446726016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787367661.390405:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367661.390434:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1fe3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787367661.390514:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726016 00000100:00100000:0.0:1787367661.390519:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726016 00000100:00100000:0.0:1787367661.390551:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787367661.390558:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446726016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787367661.390573:0:14370:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787367661.390590:0:14370:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787367661.390593:0:14370:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787367661.390677:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446726016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367661.390684:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787367661.390732:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446726016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787367661.390795:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787367661.390802:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f49b9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367661.390811:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a74c00/0xcbf1f1bac53f49b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f49b9 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367661.444472:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367662.088960:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367663.109080:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367664.132914:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367664.195405:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367664.195431:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446726144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367664.195501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367664.196323:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726144 00000100:00100000:2.0:1787367664.196334:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726144 00000100:00100000:2.0:1787367664.196435:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787367664.196446:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446726144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367664.196492:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367664.196557:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446726144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367664.196565:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787367664.196625:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367664.197665:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446726144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367665.156564:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787367665.220969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787367665.220978:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787367665.220982:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787367665.220995:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e8fb88bb800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1787367665.221048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e8e8340c380 x1874190446726528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787367665.221162:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446726272:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221425:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446726912:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221484:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367665.221489:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446726400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221549:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446726528:0@lo:8:kworker.0 00000100:00100000:2.0:1787367665.221573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221602:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446726656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787367665.221649:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446726784:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221682:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367665.221837:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726272 00000100:00100000:2.0:1787367665.221847:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726272 00000100:00100000:2.0:1787367665.221898:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367665.221907:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446726272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.221964:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446726272:12345-0@lo:400:kworker.0 Request processed in 58us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367665.221972:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787367665.222021:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726912 00000100:00100000:2.0:1787367665.222026:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726912 00000100:00100000:3.0:1787367665.222102:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726400 00000100:00100000:3.0:1787367665.222106:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726400 00000100:00100000:3.0:1787367665.222143:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726528 00000100:00100000:3.0:1787367665.222147:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726528 00000100:00100000:3.0:1787367665.222158:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367665.222166:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446726400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367665.222355:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446726400:12345-0@lo:400:kworker.0 Request processed in 189us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367665.222363:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787367665.222378:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787367665.222382:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1874190446726528:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787367665.222418:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1787367665.222456:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcbf1f1bac53f49c0 00002000:00100000:3.0:1787367665.222548:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e8f88f6b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787367665.222553:0:15064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787367665.222556:0:15064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787367665.225871:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787367665.225928:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9e8f88f6e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787367665.226048:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874190446726528:12345-0@lo:8:kworker.0 Request processed in 3662us (4471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367665.226059:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367665.226434:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726656 00000100:00100000:2.0:1787367665.226443:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726656 00000100:00100000:2.0:1787367665.226473:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446726784 00000100:00100000:2.0:1787367665.226476:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446726784 00000100:00100000:2.0:1787367665.226493:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367665.226502:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446726912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.226554:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446726912:12345-0@lo:400:kworker.0 Request processed in 54us (5099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367665.226560:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787367665.226572:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367665.226576:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446726656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.226604:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446726656:12345-0@lo:400:kworker.0 Request processed in 27us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367665.226610:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367665.226619:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787367665.226625:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446726784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.226648:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874190446726784:12345-0@lo:400:kworker.0 Request processed in 24us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367665.226661:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787367665.226687:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787367665.226745:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e8340c380 x1874190446726528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787367690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787367665.226763:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787367665.226771:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787367665.226777:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787367665.226780:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9e8fb88bb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787367665.226794:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787367665.226800:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874190446726528:0@lo:8:kworker.0 00000004:00080000:2.0:1787367665.226830:0:14401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787367665.231458:0:14402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787367665.231501:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874190446727168:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787367665.231585:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367665.231620:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787367665.231676:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727168 00000100:00100000:3.0:1787367665.231686:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727168 00000100:00100000:3.0:1787367665.231763:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787367665.231771:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14402:x1874190446727168:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787367665.232415:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 470508220735ns, next at 0ns, rc = 0 00010000:00080000:2.0:1787367665.232490:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e8340df80 x1874190446726784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367665.232510:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874190446726784:0@lo:400:kworker.0 00010000:00080000:2.0:1787367665.232523:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e8340ca80 x1874190446726656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367665.232531:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446726656:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.232690:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446726400:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.232703:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446726272:0@lo:400:kworker.0 00010000:00080000:2.0:1787367665.232716:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e8340f800 x1874190446726912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367665.232723:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446726912:0@lo:400:kworker.0 00000100:00100000:2.0:1787367665.232751:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787367665.232760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e82066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446727040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787367665.232808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787367665.244493:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367665.252285:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727040 00000100:00100000:3.0:1787367665.252302:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727040 00000100:00100000:3.0:1787367665.252361:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787367665.252374:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446727040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787367665.252417:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367665.252508:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874190446727040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (19697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367665.252515:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787367665.253044:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8e82066300 x1874190446727040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787367681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787367665.253065:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446727040:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787367665.269668:0:15064:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787367665.269682:0:15064:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787367665.269689:0:15064:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1787367665.298688:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.298701:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298721:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.298726:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.298734:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298753:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298776:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298784:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298808:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367665.298822:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367665.298828:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298836:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367665.298840:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298850:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298867:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298875:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f49c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.298894:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.298902:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.298904:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367665.299413:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.299419:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299429:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.299432:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.299437:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299446:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299453:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299460:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299479:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367665.299859:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.299865:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299874:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.299877:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.299881:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299897:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299905:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299912:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.299936:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787367665.300344:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787367665.301710:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787367665.301723:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301737:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fa00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.301742:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301753:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301778:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301786:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b8d23d5/0xcbf1f1bac53f49ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301819:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.301823:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301830:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.301833:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301841:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301851:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301859:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000417f1ac6/0xcbf1f1bac53f49d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.301870:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.301872:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.301874:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.303163:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.305124:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305709:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.305718:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.305726:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305744:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305757:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305777:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305905:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367665.305923:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367665.305930:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305939:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367665.305944:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.305954:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.306517:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.306527:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f49dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.306547:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.306549:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.306551:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787367665.310111:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1787367665.313277:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.313295:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.313356:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.313361:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.313369:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.313383:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.313394:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.313404:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.313539:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367665.314953:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.314977:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.314991:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.315011:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.315022:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.315043:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.315051:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ea75eef/0xcbf1f1bac53f49e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.315075:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.315076:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.315078:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.315354:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.315363:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315387:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.315392:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.315401:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315415:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315425:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315433:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315453:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367665.315463:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.315468:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315475:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.315479:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315487:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315511:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315519:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ae9d6b6/0xcbf1f1bac53f49ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.315534:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.315748:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.315752:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.316444:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.316453:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.316467:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.316471:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.316477:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.316489:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.316499:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.316507:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.316550:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787367665.317897:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.317910:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.317927:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.317931:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.317938:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.317951:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.317961:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.317969:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.317990:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787367665.318959:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.318969:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.318982:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.318992:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.319007:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319021:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319133:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319145:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319164:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787367665.319177:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787367665.319184:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319220:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75c00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.319225:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319236:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319253:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319272:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003393970e/0xcbf1f1bac53f49f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319290:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367665.319295:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319303:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.319307:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319315:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319326:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319334:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a3e91b/0xcbf1f1bac53f49f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319345:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.319348:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319354:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a74000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.319363:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319372:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319382:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319389:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f02f000/0xcbf1f1bac53f49ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.319402:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.319404:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.319406:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.320229:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.322170:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.322182:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322217:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.322221:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.322228:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322241:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322252:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322266:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322286:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367665.322302:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.322309:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322317:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.322321:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322331:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322350:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322358:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.322375:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.322377:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.322378:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.323106:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.323321:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.323336:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.323350:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.323354:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.323360:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.323371:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.323380:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.323388:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.323405:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787367665.324463:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367665.324475:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.324488:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367665.324493:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.324504:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.324526:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.324535:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d15d6355/0xcbf1f1bac53f4a0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.324556:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.324558:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.324559:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.324665:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.324671:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324682:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.324686:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.324692:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324703:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324717:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324724:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324736:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367665.324745:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.324749:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324756:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.324758:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324765:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324775:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324782:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.324794:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.324801:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.324802:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.325427:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.325434:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.325443:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.325448:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.325452:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.325464:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.325473:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.325480:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.325496:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787367665.327254:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.327277:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.327293:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.327298:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.327304:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328148:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328161:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328169:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328280:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787367665.328293:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787367665.328301:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328310:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367665.328316:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328723:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328743:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328751:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328783:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367665.328787:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328793:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367665.328797:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328804:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328814:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328819:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.328831:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.328832:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367665.328834:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.331484:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367665.332100:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.332112:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.332131:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.332142:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.332151:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.332168:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.332180:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.332187:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.332226:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367665.332733:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367665.332741:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.332750:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.332755:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.332772:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.332793:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.332801:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c95f7536/0xcbf1f1bac53f4a29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.332820:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.332822:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.332824:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.337878:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.337895:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.337913:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.337918:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.337925:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.337949:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.337962:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.337971:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.338014:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367665.338249:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367665.338266:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.338278:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.338283:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.338293:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.338314:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.338343:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034dee87c/0xcbf1f1bac53f4a30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.338366:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.338368:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.338371:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.338512:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.338519:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.338527:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.338532:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.339747:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.339775:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.339787:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.340518:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.340748:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367665.341460:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.341472:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.341484:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497800 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.341489:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.341502:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.341525:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.341542:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000197bc267/0xcbf1f1bac53f4a37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.341567:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.341569:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.341571:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.343247:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.343264:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343284:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.343289:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.343296:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343312:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343324:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343330:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343354:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367665.343372:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.343378:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343394:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.343399:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343408:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343427:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343435:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001447c8fc/0xcbf1f1bac53f4a3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.343464:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.343466:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.343467:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.346400:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.346415:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346435:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.346440:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.346448:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346464:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346489:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346497:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346529:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787367665.346882:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367665.346891:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346900:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367665.346905:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346914:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346935:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346944:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0a36fb5/0xcbf1f1bac53f4a45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.346966:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.346974:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.346976:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367665.349334:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.349348:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.349368:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.349373:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.349381:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.349395:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.349406:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.349414:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.349439:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367665.349911:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.349919:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.349932:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.349937:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.349948:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.349966:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.349974:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dfa8435/0xcbf1f1bac53f4a4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.350006:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.350009:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.350010:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787367665.350124:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787367665.352069:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.352085:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.352107:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.352112:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.352119:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.352895:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.352915:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.352923:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.353781:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787367665.354553:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.354564:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.354582:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.354587:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.354594:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.354607:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.354617:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.354637:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356242:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367665.356257:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356270:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.356274:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356284:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356307:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356315:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016bd81e4/0xcbf1f1bac53f4a53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356341:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367665.356346:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356366:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.356370:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356378:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356388:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.356396:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.356397:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.356398:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.358970:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787367665.358988:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c651f/0xcbf1f1bac53f4a5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787367665.361921:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.361934:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.361952:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.361957:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.361964:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.361978:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.361989:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362006:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362045:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787367665.362511:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.362518:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362527:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.362530:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367665.362745:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.362754:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.362765:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.362770:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.362781:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.362807:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.362816:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de64b508/0xcbf1f1bac53f4a61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.362840:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.362842:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.362844:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.362869:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367665.362937:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362952:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362961:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.362969:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.363030:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787367665.363519:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787367665.363527:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.363725:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=470s v=(0 0) 00010000:00010000:2.0:1787367665.363737:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367665.363743:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.363755:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.363765:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.363773:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.366736:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787367665.366755:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.366771:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496a00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.366775:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.366787:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.366814:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.367132:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deda8986/0xcbf1f1bac53f4a68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367665.367392:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787367665.367414:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.367422:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.367433:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.367437:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.367458:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.367466:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.367472:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.367482:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c477c1b/0xcbf1f1bac53f4a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.367500:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.367502:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.367504:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367665.368638:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.368650:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.368666:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.368671:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.368677:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.368693:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.368703:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.368717:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.368736:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367665.368763:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367665.368772:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.368781:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ee00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.368785:0:15518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.368793:0:15518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.368808:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.368815:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000732bd46/0xcbf1f1bac53f4a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.369331:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.369335:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.369337:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367665.370230:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.370242:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.371406:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.371419:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.371428:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.371450:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.371462:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.371470:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.371500:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787367665.372572:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787367665.372583:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.372611:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367665.372617:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.372629:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.372652:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.372661:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002110c4a1/0xcbf1f1bac53f4a7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367665.372689:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.372692:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367665.372694:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787367665.373748:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787367665.373763:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.373785:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1787367665.373790:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787367665.374080:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.374097:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.374107:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.374114:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367665.374187:0:15064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787367665.374544:0:15064:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787367665.374658:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14402:x1874190446727168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 142883us (143068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367665.374672:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787367665.374813:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e82064e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874190446727168:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787367665.374831:0:14402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787367665.374878:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874190446727296:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787367665.374916:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367665.374970:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f91d67a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787367665.376981:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727296 00000100:00100000:3.0:1787367665.377029:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727296 00000100:00100000:3.0:1787367665.377110:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367665.377119:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14402:x1874190446727296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787367665.377184:0:15063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1787367665.382719:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787367665.382734:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.382749:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f400 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367665.382755:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.382767:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.382792:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.382824:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004626ae5d/0xcbf1f1bac53f4a84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367665.382852:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.382854:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787367665.382856:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367665.387612:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14402:x1874190446727296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10486us (12687us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787367665.387638:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787367665.390267:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1874190446727296:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787367665.390299:0:14402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787367666.184373:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787367667.205149:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787367667.759645:0:16153:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787367668.233793:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367669.252996:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367669.315420:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446727424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367669.315524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367669.315931:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727424 00000100:00100000:2.0:1787367669.315940:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727424 00000100:00100000:2.0:1787367669.316019:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367669.316030:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446727424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367669.316073:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367669.316133:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446727424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367669.316141:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787367669.316310:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367669.316358:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8e8340d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446727424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787367670.275542:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367670.339633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446727552:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.339722:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.339792:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446728064:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.339821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.339866:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787367670.339872:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446727936:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.339894:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.339931:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446727808:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.339957:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.339975:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787367670.339980:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446727680:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.340001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.340016:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446728192:0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.340036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367670.340068:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728064 00000100:00100000:2.0:1787367670.340078:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728064 00000100:00100000:2.0:1787367670.340130:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727936 00000100:00100000:2.0:1787367670.340134:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727936 00000100:00100000:2.0:1787367670.340146:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728192 00000100:00100000:2.0:1787367670.340149:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728192 00000100:00100000:2.0:1787367670.340165:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367670.340176:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446728064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.340263:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446728064:12345-0@lo:400:kworker.0 Request processed in 88us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.340271:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787367670.340289:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367670.340296:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446727936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.340324:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446727936:12345-0@lo:400:kworker.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.340329:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787367670.340338:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787367670.340352:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446728192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367670.340386:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446728192:12345-0@lo:400:kworker.0 Request processed in 35us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.340392:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787367670.340417:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787367670.340447:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014ca80 x1874190446728192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367670.340461:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446728192:0@lo:400:kworker.0 00010000:00080000:2.0:1787367670.340488:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014ed80 x1874190446727936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367670.340496:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446727936:0@lo:400:kworker.0 00010000:00080000:2.0:1787367670.340506:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e8fa014f100 x1874190446728064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787367686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787367670.340514:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446728064:0@lo:400:kworker.0 00000100:00100000:1.0:1787367670.340928:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727552 00000100:00100000:1.0:1787367670.340936:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727552 00000100:00100000:1.0:1787367670.340978:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787367670.340986:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa0154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3311:x1874190446727552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367670.341037:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa0154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3311:x1874190446727552:12345-0@lo:400:kworker.0 Request processed in 52us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.341043:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787367670.341079:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446727552:0@lo:400:kworker.0 00000100:00100000:0.0:1787367670.341307:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727808 00000100:00100000:0.0:1787367670.341312:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727808 00000100:00100000:0.0:1787367670.341345:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446727680 00000100:00100000:0.0:1787367670.341348:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446727680 00000100:00100000:0.0:1787367670.341363:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367670.341369:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446727808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367670.341405:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446727808:12345-0@lo:400:kworker.0 Request processed in 37us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.341412:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787367670.341424:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787367670.341430:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446727680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367670.341456:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446727680:12345-0@lo:400:kworker.0 Request processed in 27us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.341462:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787367670.341476:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367670.341487:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446728320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367670.341516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367670.341545:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446727680:0@lo:400:kworker.0 00000100:00100000:0.0:1787367670.341555:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446727808:0@lo:400:kworker.0 00000100:00100000:0.0:1787367670.341576:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728320 00000100:00100000:0.0:1787367670.341579:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728320 00000100:00100000:0.0:1787367670.341601:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367670.341608:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446728320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367670.341653:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367670.341693:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874190446728320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.341699:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367670.341728:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446728320:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787367670.410821:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1787367670.513165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367670.513398:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760128 00000100:00100000:2.0:1787367670.513409:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760128 00000100:00100000:2.0:1787367670.513458:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:2.0:1787367670.513467:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1874190425760128:12345-192.168.204.23@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787367670.513499:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4ffb7871-5095-4de5-b072-071bd98a5440@192.168.204.23@tcp t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1787367670.513536:0:14370:0:(genops.c:1385:class_connect()) connect: client 4ffb7871-5095-4de5-b072-071bd98a5440, cookie 0xcbf1f1bac53f4a8b 00000100:00080000:2.0:1787367670.513674:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9e8fb3469000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787367670.513763:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+5:2355:x1874190425760128:12345-192.168.204.23@tcp:250:mount.lustre.0 Request processed in 295us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.513771:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:2.0:1787367670.518806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.524107:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760256 00000100:00100000:0.0:1787367670.524133:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760256 00000100:00100000:0.0:1787367670.524230:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:0.0:1787367670.524241:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f83c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+5:13775:x1874190425760256:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367670.524258:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367670.524278:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598600/0xcbf1f1bac53f4a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5db1 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.524306:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598600/0xcbf1f1bac53f4a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5db1 expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.524318:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598600/0xcbf1f1bac53f4a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5db1 expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.524328:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598600, rc 0) 00000100:00100000:0.0:1787367670.524402:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f83c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+6:13775:x1874190425760256:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 162us (5605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.524411:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1787367670.534669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.535477:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760384 00000100:00100000:1.0:1787367670.535488:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760384 00000100:00100000:1.0:1787367670.535550:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:1.0:1787367670.535561:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+6:13775:x1874190425760384:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787367670.536919:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+6:13775:x1874190425760384:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 1352us (2253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787367670.536953:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:1.0:1787367670.552312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367670.556922:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760512 00000100:00100000:2.0:1787367670.557801:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760512 00000100:00100000:2.0:1787367670.557883:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:2.0:1787367670.557907:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+6:13775:x1874190425760512:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787367670.557925:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367670.558345:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f4a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5db8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.558386:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f4a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5db8 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.558399:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497400/0xcbf1f1bac53f4a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5db8 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.558410:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497400, rc 0) 00000100:00100000:2.0:1787367670.558554:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+7:13775:x1874190425760512:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 661us (6256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.558565:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:2.0:1787367670.573595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.581112:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760640 00000100:00100000:1.0:1787367670.581127:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760640 00000100:00100000:1.0:1787367670.581218:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1787367670.581229:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+7:13775:x1874190425760640:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787367670.581532:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+8:13775:x1874190425760640:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 304us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.581541:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:3.0:1787367670.592306:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367670.592465:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760768 00000100:00100000:2.0:1787367670.592477:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760768 00000100:00100000:2.0:1787367670.592540:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:2.0:1787367670.592550:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+8:13775:x1874190425760768:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787367670.592859:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+8:13775:x1874190425760768:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 310us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.592868:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:2.0:1787367670.597054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.597166:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425760896 00000100:00100000:0.0:1787367670.597177:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425760896 00000100:00100000:0.0:1787367670.597269:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:0.0:1787367670.597280:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+8:13793:x1874190425760896:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367670.597656:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+8:13793:x1874190425760896:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 377us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.597664:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:3.0:1787367670.631567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.631691:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761024 00000100:00100000:1.0:1787367670.631703:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761024 00000100:00100000:1.0:1787367670.631777:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:1.0:1787367670.631788:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+8:13793:x1874190425761024:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367670.632503:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+8:13793:x1874190425761024:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 710us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.632513:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:3.0:1787367670.642792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367670.643480:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761152 00000100:00100000:2.0:1787367670.643492:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761152 00000100:00100000:2.0:1787367670.643557:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:2.0:1787367670.643567:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+8:13775:x1874190425761152:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787367670.643583:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367670.643601:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f4aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5de2 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.643632:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f4aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5de2 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.643643:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497200/0xcbf1f1bac53f4aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5de2 expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367670.643651:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497200, rc 0) 00000100:00100000:2.0:1787367670.643712:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+9:13775:x1874190425761152:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 146us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.643718:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:2.0:1787367670.656617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.656721:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761280 00000100:00100000:1.0:1787367670.656732:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761280 00000100:00100000:1.0:1787367670.656788:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:1.0:1787367670.656798:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+9:13775:x1874190425761280:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787367670.656825:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787367670.656850:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787367670.656855:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787367670.656858:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787367670.656860:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787367670.669137:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+9:13775:x1874190425761280:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 12328us (12520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.669153:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:3.0:1787367670.676686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.680430:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761408 00000100:00100000:0.0:1787367670.680446:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761408 00000100:00100000:0.0:1787367670.680527:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:0.0:1787367670.680538:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+9:13775:x1874190425761408:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367670.680556:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367670.680577:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5de9 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.680609:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 10 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.680621:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 10 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367670.680631:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598000, rc 0) 00000100:00100000:0.0:1787367670.680707:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+10:13775:x1874190425761408:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 170us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.680715:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:2.0:1787367670.684734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.684841:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761536 00000100:00100000:1.0:1787367670.684853:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761536 00000100:00100000:1.0:1787367670.684924:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:1.0:1787367670.684935:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+10:13775:x1874190425761536:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787367670.685307:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+10:13775:x1874190425761536:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 372us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.685317:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:2.0:1787367670.688242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.688326:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761664 00000100:00100000:0.0:1787367670.688336:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761664 00000100:00100000:0.0:1787367670.688391:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:0.0:1787367670.688401:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+10:13775:x1874190425761664:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787367670.688764:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+10:13775:x1874190425761664:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 363us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.688779:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:3.0:1787367670.708461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.712361:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761792 00000100:00100000:0.0:1787367670.712378:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761792 00000100:00100000:0.0:1787367670.712463:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:0.0:1787367670.712474:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+10:13797:x1874190425761792:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367670.716755:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+10:13797:x1874190425761792:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 4269us (8295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.716770:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:2.0:1787367670.720938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.723010:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425761920 00000100:00100000:1.0:1787367670.723024:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425761920 00000100:00100000:1.0:1787367670.723101:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1787367670.723111:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+10:13797:x1874190425761920:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787367670.723489:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+10:13797:x1874190425761920:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 378us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.723499:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:2.0:1787367670.735705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.735938:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762048 00000100:00100000:0.0:1787367670.735948:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762048 00000100:00100000:0.0:1787367670.735995:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1787367670.736004:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874190425762048:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787367670.736046:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a0bdbf83-8dcc-47ff-b097-a61c82195927@192.168.204.23@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1787367670.736096:0:14377:0:(genops.c:1385:class_connect()) connect: client a0bdbf83-8dcc-47ff-b097-a61c82195927, cookie 0xcbf1f1bac53f4aae 00000004:00100000:0.0:1787367670.736130:0:14377:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787367670.736136:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787367670.798858:0:14377:0:(import.c:65:import_set_state_nolock()) ffff9e8fbfa06000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367670.798969:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2355:x1874190425762048:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 62963us (63276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367670.798980:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:3.0:1787367670.808734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367670.808784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.809055:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762304 00000100:00100000:0.0:1787367670.809066:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762304 00000100:00100000:0.0:1787367670.809152:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762176 00000100:00100000:0.0:1787367670.809156:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762176 00000100:00100000:0.0:1787367670.809175:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1787367670.809185:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:13775:x1874190425762304:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787367670.809275:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787367670.809433:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:13775:x1874190425762304:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 249us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.809459:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1787367670.809477:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:0.0:1787367670.809485:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:0:x1874190425762176:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787367670.809498:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787367670.809523:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:0:x1874190425762176:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 39us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.809529:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00080000:1.0:1787367670.809664:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367670.818430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.818652:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762432 00000100:00100000:0.0:1787367670.818662:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762432 00000100:00100000:0.0:1787367670.818727:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367670.818737:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13775:x1874190425762432:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787367670.818957:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13775:x1874190425762432:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 221us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.818967:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1787367670.823364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367670.823427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367670.823509:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762560 00000100:00100000:0.0:1787367670.823520:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762560 00000100:00100000:0.0:1787367670.823569:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762688 00000100:00100000:0.0:1787367670.823572:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762688 00000100:00100000:0.0:1787367670.823589:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367670.823598:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874190425762560:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787367670.823632:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a0bdbf83-8dcc-47ff-b097-a61c82195927@192.168.204.23@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1787367670.823665:0:15061:0:(genops.c:1385:class_connect()) connect: client a0bdbf83-8dcc-47ff-b097-a61c82195927, cookie 0xcbf1f1bac53f4ab5 00002000:00100000:0.0:1787367670.823677:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a0bdbf83-8dcc-47ff-b097-a61c82195927/ffff9e8fbb1a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367670.823705:0:15061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367670.824481:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787367670.824517:0:15061:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367670.824696:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2355:x1874190425762560:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 1097us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.824705:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367670.824730:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1787367670.824736:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874190425762688:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787367670.824768:0:15061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a0bdbf83-8dcc-47ff-b097-a61c82195927@192.168.204.23@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1787367670.824797:0:15061:0:(genops.c:1385:class_connect()) connect: client a0bdbf83-8dcc-47ff-b097-a61c82195927, cookie 0xcbf1f1bac53f4abc 00002000:00100000:0.0:1787367670.824805:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a0bdbf83-8dcc-47ff-b097-a61c82195927/ffff9e8fbb1a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367670.824813:0:15061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367670.825274:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787367670.825294:0:15061:0:(import.c:65:import_set_state_nolock()) ffff9e8fbb1a1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367670.825326:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2355:x1874190425762688:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 589us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367670.825333:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367670.829594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367670.829709:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762816 00000100:00100000:1.0:1787367670.829720:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762816 00000100:00100000:1.0:1787367670.829786:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367670.829796:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13775:x1874190425762816:12345-192.168.204.23@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787367670.831323:0:14379:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1448us 00000004:00200000:2.0:1787367670.847821:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787367670.848017:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13775:x1874190425762816:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 18216us (18426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367670.848033:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000001:00100000:2.0:1787367670.924875:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0bdbf83-8dcc-47ff-b097-a61c82195927 00000100:00100000:2.0:1787367671.100572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367671.100809:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425762944 00000100:00100000:0.0:1787367671.100820:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425762944 00000100:00100000:0.0:1787367671.100905:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1787367671.100917:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13818:x1874190425762944:12345-192.168.204.23@tcp:101:mkdir.0 00010000:00010000:0.0:1787367671.100944:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367671.100975:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f4ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e13 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101083:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101119:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101136:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367671.101726:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787367671.101732:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367671.101834:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101864:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598800/0xcbf1f1bac53f4ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e13 expref: 8 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101881:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e13 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367671.101904:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:0.0:1787367671.101907:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367671.101911:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf599a00, rc 0) 00000100:00100000:0.0:1787367671.101991:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:13818:x1874190425762944:12345-192.168.204.23@tcp:101:mkdir.0 Request processed in 1076us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367671.101999:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:1.0:1787367671.300630:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787367671.683891:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787367672.325770:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367673.208049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.208909:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763072 00000100:00100000:0.0:1787367673.208929:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763072 00000100:00100000:0.0:1787367673.209150:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367673.209171:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:13871:x1874190425763072:12345-192.168.204.23@tcp:41:lfs.0 00000004:00000024:0.0:1787367673.209260:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787367673.209377:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:13871:x1874190425763072:12345-192.168.204.23@tcp:41:lfs.0 Request processed in 216us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.209386:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:1.0:1787367673.209749:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367673.216613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.217009:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763200 00000100:00100000:0.0:1787367673.217034:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763200 00000100:00100000:0.0:1787367673.217131:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:0.0:1787367673.217145:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:13871:x1874190425763200:12345-192.168.204.23@tcp:13:lfs.0 00000100:00080000:1.0:1787367673.217168:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787367673.217247:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367673.217369:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:13871:x1874190425763200:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 225us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.217379:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1787367673.221301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.221564:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763328 00000100:00100000:0.0:1787367673.221578:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763328 00000100:00100000:0.0:1787367673.221668:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1787367673.221681:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13871:x1874190425763328:12345-192.168.204.23@tcp:13:lfs.0 00000100:00080000:1.0:1787367673.221871:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787367673.222126:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367673.222329:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:13871:x1874190425763328:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 648us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.222339:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00010000:00010000:0.0:1787367673.347571:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367673.440051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.440229:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763456 00000100:00100000:0.0:1787367673.440243:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763456 00000100:00100000:0.0:1787367673.440318:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:0.0:1787367673.440331:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+10:13903:x1874190425763456:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367673.440356:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367673.440382:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f4ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5e1a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.440441:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f4ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e1a expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.440456:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598800/0xcbf1f1bac53f4ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e1a expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.440468:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598800, rc 0) 00000100:00100000:0.0:1787367673.440553:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425763456:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 223us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.440561:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:2.0:1787367673.448535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.449917:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763584 00000100:00100000:0.0:1787367673.449935:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763584 00000100:00100000:0.0:1787367673.450026:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:0.0:1787367673.450038:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425763584:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787367673.452933:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425763584:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 2876us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.452954:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:2.0:1787367673.475327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367673.475880:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763712 00000100:00100000:1.0:1787367673.475894:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763712 00000100:00100000:1.0:1787367673.475975:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:1.0:1787367673.475987:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425763712:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787367673.476577:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425763712:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 590us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367673.476587:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:2.0:1787367673.490089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.490858:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763840 00000100:00100000:0.0:1787367673.490874:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763840 00000100:00100000:0.0:1787367673.490954:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:0.0:1787367673.490967:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+11:13910:x1874190425763840:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787367673.491515:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+11:13910:x1874190425763840:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 548us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.491528:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:3.0:1787367673.519915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367673.520115:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425763968 00000100:00100000:2.0:1787367673.520129:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425763968 00000100:00100000:2.0:1787367673.523418:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:2.0:1787367673.523455:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+11:13910:x1874190425763968:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367673.523894:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+11:13910:x1874190425763968:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 457us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367673.523904:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:1.0:1787367673.532025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367673.532565:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764096 00000100:00100000:3.0:1787367673.532580:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764096 00000100:00100000:3.0:1787367673.532659:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:3.0:1787367673.532672:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+11:13903:x1874190425764096:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787367673.532708:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367673.532731:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f4ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5e44 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367673.532770:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f4ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e44 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367673.532783:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fb357f000/0xcbf1f1bac53f4ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e44 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367673.532812:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f000, rc 0) 00000100:00100000:3.0:1787367673.532907:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+12:13903:x1874190425764096:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 237us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367673.532916:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:3.0:1787367673.538634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367673.538890:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764224 00000100:00100000:2.0:1787367673.538904:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764224 00000100:00100000:2.0:1787367673.539083:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:2.0:1787367673.539098:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+12:13903:x1874190425764224:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787367673.539138:0:14369:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787367673.539178:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787367673.539365:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787367673.539370:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787367673.539373:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787367673.542674:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+12:13903:x1874190425764224:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 3563us (4040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.542827:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:1.0:1787367673.547577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.547957:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764352 00000100:00100000:0.0:1787367673.547971:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764352 00000100:00100000:0.0:1787367673.548463:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:0.0:1787367673.548476:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+12:13903:x1874190425764352:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787367673.548501:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367673.548527:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5e4b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.548566:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.548580:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.548590:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598a00, rc 0) 00000100:00100000:0.0:1787367673.548680:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:13903:x1874190425764352:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 207us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.548688:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:2.0:1787367673.551443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.551548:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764480 00000100:00100000:0.0:1787367673.551562:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764480 00000100:00100000:0.0:1787367673.551671:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:0.0:1787367673.551682:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:13903:x1874190425764480:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787367673.552342:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:13903:x1874190425764480:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 658us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.552353:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:2.0:1787367673.558342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.558473:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764608 00000100:00100000:0.0:1787367673.558487:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764608 00000100:00100000:0.0:1787367673.558619:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:0.0:1787367673.558632:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:13903:x1874190425764608:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787367673.559246:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:13903:x1874190425764608:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 613us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.559258:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:1.0:1787367673.564068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367673.564343:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764736 00000100:00100000:2.0:1787367673.564358:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764736 00000100:00100000:2.0:1787367673.564431:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:2.0:1787367673.564444:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:13915:x1874190425764736:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787367673.565378:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:13915:x1874190425764736:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 929us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367673.565391:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:2.0:1787367673.579270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367673.579480:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764864 00000100:00100000:3.0:1787367673.579494:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764864 00000100:00100000:3.0:1787367673.579560:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:3.0:1787367673.579572:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+13:13915:x1874190425764864:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787367673.579930:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+13:13915:x1874190425764864:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 359us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367673.579940:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:3.0:1787367673.585007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367673.585579:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425764992 00000100:00100000:1.0:1787367673.585594:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425764992 00000100:00100000:1.0:1787367673.586379:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1787367673.586391:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874190425764992:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787367673.586437:0:14377:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 270d9d40-a94a-419f-bb3a-a7459bf87377@192.168.204.23@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1787367673.586491:0:14377:0:(genops.c:1385:class_connect()) connect: client 270d9d40-a94a-419f-bb3a-a7459bf87377, cookie 0xcbf1f1bac53f4ae6 00000004:00100000:1.0:1787367673.586536:0:14377:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787367673.586784:0:14377:0:(import.c:65:import_set_state_nolock()) ffff9e8fa0187000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787367673.586907:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2355:x1874190425764992:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 516us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367673.586917:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1787367673.605109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.605339:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765248 00000100:00100000:0.0:1787367673.605353:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765248 00000100:00100000:0.0:1787367673.605451:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367673.605462:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765248:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787367673.605506:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787367673.605609:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765248:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 148us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.605617:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00080000:1.0:1787367673.606374:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367673.610282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367673.610457:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765376 00000100:00100000:1.0:1787367673.610471:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765376 00000100:00100000:1.0:1787367673.610541:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1787367673.610553:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765376:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787367673.610693:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765376:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 142us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367673.610703:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1787367673.612447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367673.612550:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765120 00000100:00100000:2.0:1787367673.612561:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765120 00000100:00100000:2.0:1787367673.612626:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1787367673.612637:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+6:0:x1874190425765120:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787367673.612677:0:14376:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787367673.612769:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+6:0:x1874190425765120:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 134us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367673.612778:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1787367673.614935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367673.615498:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765760 00000100:00100000:1.0:1787367673.615514:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765760 00000100:00100000:1.0:1787367673.615587:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:1.0:1787367673.615599:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765760:12345-192.168.204.23@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787367673.615968:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787367673.616165:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13903:x1874190425765760:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 566us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367673.616175:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1787367673.616594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367673.616701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.617073:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765504 00000100:00100000:0.0:1787367673.617082:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765504 00000100:00100000:0.0:1787367673.617130:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765632 00000100:00100000:0.0:1787367673.617134:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765632 00000100:00100000:0.0:1787367673.617148:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367673.617154:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874190425765504:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787367673.617210:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 270d9d40-a94a-419f-bb3a-a7459bf87377@192.168.204.23@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787367673.617260:0:15064:0:(genops.c:1385:class_connect()) connect: client 270d9d40-a94a-419f-bb3a-a7459bf87377, cookie 0xcbf1f1bac53f4aed 00002000:00100000:0.0:1787367673.617275:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 270d9d40-a94a-419f-bb3a-a7459bf87377/ffff9e8f9135a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367673.617289:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367673.617586:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787367673.617625:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9e8f91359000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367673.617699:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2355:x1874190425765504:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 543us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.617708:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367673.617730:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1787367673.617736:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874190425765632:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787367673.617753:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 270d9d40-a94a-419f-bb3a-a7459bf87377@192.168.204.23@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787367673.617773:0:15064:0:(genops.c:1385:class_connect()) connect: client 270d9d40-a94a-419f-bb3a-a7459bf87377, cookie 0xcbf1f1bac53f4af4 00002000:00100000:0.0:1787367673.617778:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 270d9d40-a94a-419f-bb3a-a7459bf87377/ffff9e8f9135d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787367673.617784:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787367673.617862:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787367673.617877:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9e8f91359800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787367673.617899:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2355:x1874190425765632:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 163us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.617917:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1787367673.819366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367673.819583:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425765888 00000100:00100000:0.0:1787367673.819596:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425765888 00000100:00100000:0.0:1787367673.819683:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1787367673.819695:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:13936:x1874190425765888:12345-192.168.204.23@tcp:101:mkdir.0 00010000:00010000:0.0:1787367673.819722:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367673.819750:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599400/0xcbf1f1bac53f4afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e75 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.819854:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.819890:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.819909:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367673.820269:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787367673.820276:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367673.820372:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.820410:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599400/0xcbf1f1bac53f4afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.820431:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367673.820440:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:0.0:1787367673.820444:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367673.820447:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fbf598e00, rc 0) 00000100:00100000:0.0:1787367673.820553:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+7:13936:x1874190425765888:12345-192.168.204.23@tcp:101:mkdir.0 Request processed in 858us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367673.820562:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00010000:00010000:1.0:1787367674.371634:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367674.437668:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787367674.437769:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446728448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367674.437891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367674.447041:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728448 00000100:00100000:3.0:1787367674.447065:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728448 00000100:00080000:0.0:1787367674.448669:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367674.454711:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787367674.454922:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446728448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367674.455029:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367674.455546:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446728448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 816us (17653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367674.455565:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787367674.455610:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446728448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367675.395517:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367675.465644:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367675.465690:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446728576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367675.465790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367675.465882:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728576 00000100:00100000:0.0:1787367675.465905:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728576 00000100:00100000:0.0:1787367675.466171:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787367675.466183:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446728576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367675.466315:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367675.466377:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446728576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367675.466386:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787367675.466414:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367675.466452:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787367675.466485:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446728576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367675.470468:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446728704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.470569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367675.470683:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728704 00000100:00100000:3.0:1787367675.470693:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728704 00000100:00100000:3.0:1787367675.470746:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367675.470927:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446728704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.470992:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446728704:12345-0@lo:400:kworker.0 Request processed in 69us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367675.471001:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787367675.471700:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446728704:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473095:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446728832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473224:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367675.473292:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728832 00000100:00100000:3.0:1787367675.473299:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728832 00000100:00100000:3.0:1787367675.473357:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367675.473367:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473421:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874190446728832:12345-0@lo:400:kworker.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367675.473429:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787367675.473471:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874190446728832:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473521:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446728960:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367675.473587:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446728960 00000100:00100000:3.0:1787367675.473605:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446728960 00000100:00100000:3.0:1787367675.473636:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367675.473643:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473679:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446728960:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367675.473702:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787367675.473731:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446728960:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473761:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446729088:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.473792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367675.475579:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729088 00000100:00100000:3.0:1787367675.475591:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729088 00000100:00100000:3.0:1787367675.475664:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787367675.475674:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446729088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.475740:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446729088:12345-0@lo:400:kworker.0 Request processed in 69us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367675.475748:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787367675.475767:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367675.475823:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446729088:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.478408:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446729216:0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.478494:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367675.478576:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729216 00000100:00100000:3.0:1787367675.478584:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729216 00000100:00100000:3.0:1787367675.478643:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787367675.478651:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367675.478709:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446729216:12345-0@lo:400:kworker.0 Request processed in 59us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367675.478728:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787367675.478749:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787367675.478784:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446729216:0@lo:400:kworker.0 00000001:00100000:3.0:1787367675.593702:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 270d9d40-a94a-419f-bb3a-a7459bf87377 00000001:00100000:3.0:1787367675.593720:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0bdbf83-8dcc-47ff-b097-a61c82195927 00000001:00100000:0.0:1787367676.056078:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 270d9d40-a94a-419f-bb3a-a7459bf87377 00000001:00100000:0.0:1787367676.056096:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0bdbf83-8dcc-47ff-b097-a61c82195927 00000001:00100000:2.0:1787367676.066491:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 270d9d40-a94a-419f-bb3a-a7459bf87377 00010000:00010000:2.0:1787367676.420125:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787367676.888302:0:16362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787367677.447031:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367678.467490:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367678.727386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727528:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367678.727589:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766016 00000100:00100000:3.0:1787367678.727601:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766016 00000100:00100000:3.0:1787367678.727669:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00100000:3.0:1787367678.727679:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:2359:x1874190425766016:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.727785:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:2359:x1874190425766016:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 106us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.727794:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00100000:3.0:1787367678.727836:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766272 00000100:00100000:3.0:1787367678.727840:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766272 00000100:00100000:3.0:1787367678.727875:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766784 00000100:00100000:3.0:1787367678.727878:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766784 00000100:00100000:3.0:1787367678.727892:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766400 00000100:00100000:3.0:1787367678.727895:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766400 00000100:00100000:3.0:1787367678.727907:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766656 00000100:00100000:3.0:1787367678.727922:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766656 00000100:00100000:3.0:1787367678.727943:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1787367678.727950:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2359:x1874190425766272:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.727986:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2359:x1874190425766272:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.727993:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1787367678.728004:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367678.728010:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2359:x1874190425766784:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.728037:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2359:x1874190425766784:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 27us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.728043:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367678.728053:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1787367678.728059:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2359:x1874190425766400:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.728086:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2359:x1874190425766400:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.728092:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1787367678.728103:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1787367678.728109:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2359:x1874190425766656:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.728131:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2359:x1874190425766656:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.728137:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1787367678.728156:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766528 00000100:00100000:3.0:1787367678.728159:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766528 00000100:00100000:3.0:1787367678.728189:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766144 00000100:00100000:3.0:1787367678.728229:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766144 00000100:00100000:3.0:1787367678.728250:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1787367678.728257:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2359:x1874190425766528:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.728293:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2359:x1874190425766528:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.728300:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1787367678.728313:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1787367678.728319:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2359:x1874190425766144:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367678.728345:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2359:x1874190425766144:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367678.728350:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00080000:3.0:1787367678.728562:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787367678.728568:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787367678.728570:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787367679.491786:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367679.567906:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367679.567944:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446729344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787367679.568034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367679.568115:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729344 00000100:00100000:3.0:1787367679.568124:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729344 00000100:00100000:3.0:1787367679.568222:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787367679.568223:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367679.568241:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446729344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787367679.568289:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787367679.568371:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446729344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367679.568378:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367679.570038:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446729344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787367680.520051:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367680.580340:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446729472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787367680.580617:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367680.580847:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729472 00000100:00100000:0.0:1787367680.580863:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729472 00000100:00100000:0.0:1787367680.581175:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787367680.581189:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446729472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367680.581265:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367680.581354:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446729472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367680.581361:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787367680.581421:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787367680.581908:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446729472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367680.582281:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446729600:0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.582339:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446729728:0@lo:400:kworker.0 00000100:00100000:0.0:1787367680.582352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367680.582406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367680.582427:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446730112:0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.582451:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367680.582463:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446729856:0@lo:400:kworker.0 00000100:00100000:0.0:1787367680.582478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367680.582511:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367680.582516:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787367680.582528:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446729984:0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.582586:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729728 00000100:00100000:0.0:1787367680.582594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367680.582595:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729728 00000100:00100000:1.0:1787367680.582669:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367680.582680:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446729728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.582779:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446729728:12345-0@lo:400:kworker.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367680.582787:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787367680.582813:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446730112 00000100:00100000:1.0:1787367680.582818:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446730112 00000100:00100000:1.0:1787367680.582858:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729856 00000100:00100000:1.0:1787367680.582861:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729856 00000100:00100000:1.0:1787367680.582874:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729984 00000100:00100000:1.0:1787367680.582877:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729984 00000100:00100000:1.0:1787367680.582891:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787367680.582897:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446730112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367680.582952:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446729728:0@lo:400:kworker.0 00000100:00100000:2.0:1787367680.583240:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787367680.583250:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787367680.583267:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446729600 00000100:00100000:2.0:1787367680.583273:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446729600 00000100:00100000:2.0:1787367680.583306:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787367680.583315:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3311:x1874190446729600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787367680.583407:0:14376:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787367680.583444:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787367680.583455:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446729856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.583667:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874190446730112:12345-0@lo:400:kworker.0 Request processed in 768us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367680.583677:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787367680.583683:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3311:x1874190446729600:12345-0@lo:400:kworker.0 Request processed in 364us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.583693:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787367680.583912:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367680.583962:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874190446730112:0@lo:400:kworker.0 00000100:00100000:1.0:1787367680.583984:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74b4a5c6-75ad-491b-a27a-c62858f32053:3311:1874190446729600:0@lo:400:kworker.0 00000100:00100000:2.0:1787367680.584022:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787367680.584037:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446729984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367680.584174:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874190446729984:12345-0@lo:400:kworker.0 Request processed in 142us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.584183:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787367680.584500:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874190446729984:0@lo:400:kworker.0 00000100:00100000:3.0:1787367680.584729:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874190446729856:12345-0@lo:400:kworker.0 Request processed in 1276us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367680.584738:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787367680.589746:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fa014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874190446729856:0@lo:400:kworker.0 00000020:00000080:2.0:1787367680.653079:0:16511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec788ddc0 20000000:00000080:2.0:1787367680.653104:0:16511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e8fbef0e400 uarg=0000000000000000 20000000:01000000:2.0:1787367680.653152:0:16511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787367680.653160:0:16511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787367680.653166:0:16511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787367680.654353:0:16512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787367680.654671:0:16511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787367680.662442:0:16511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787367680.662487:0:16511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662513:0:16511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662543:0:16511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662550:0:16511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662635:0:16511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662645:0:16511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662652:0:16511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662722:0:16511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.662741:0:16511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 12 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.662761:0:16511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730240:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367680.663013:0:16511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.663022:0:16511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 12 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.663032:0:16511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730368:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367680.663077:0:16511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.663087:0:16511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 18 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.663097:0:16511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730496:0@lo:104: 00000100:00100000:2.0:1787367680.663149:0:16511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367680.663244:0:16511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.663253:0:16511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.663262:0:16511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730624:0@lo:104: 00000100:00100000:2.0:1787367680.663285:0:16511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367680.663323:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446730496 00000100:00100000:2.0:1787367680.663331:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446730496 00000100:00100000:2.0:1787367680.663379:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446730624 00000100:00100000:2.0:1787367680.663382:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446730624 00000100:00100000:2.0:1787367680.663397:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367680.663407:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+4:16511:x1874190446730496:12345-0@lo:104: 00010000:00010000:2.0:1787367680.663422:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.663477:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367680.663483:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+4:16511:x1874190446730496:12345-0@lo:104: Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.663490:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367680.663520:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367680.663527:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:16511:x1874190446730624:12345-0@lo:104: 00010000:00010000:2.0:1787367680.663534:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.663725:0:16511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.663734:0:16511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 18 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367680.663743:0:16511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730752:0@lo:104: 00000100:00100000:3.0:1787367680.663790:0:16511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367680.663823:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787367680.663865:0:14359:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787367680.663876:0:14359:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787367680.663898:0:16511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fbc19ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787367680.663928:0:16511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730496:0@lo:104: 00010000:00010000:3.0:1787367680.663953:0:15518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787367680.663961:0:15518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.663969:0:15518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357fe00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:3.0:1787367680.663973:0:15518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.663983:0:15518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787367680.663991:0:15518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367680.664004:0:15518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787367680.664043:0:15518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.664050:0:15518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787367680.664075:0:15518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.664083:0:15518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f497a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4981 expref: -99 pid: 15781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367680.664098:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367680.664100:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367680.664102:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367680.664262:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787367680.664268:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:16511:x1874190446730624:12345-0@lo:104: Request processed in 742us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.664276:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787367680.664290:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446730752 00000100:00100000:2.0:1787367680.664293:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446730752 00000100:00100000:2.0:1787367680.664308:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787367680.664314:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbae6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:16511:x1874190446730752:12345-0@lo:104: 00010000:00010000:2.0:1787367680.664322:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664358:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787367680.664362:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbae6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74b4a5c6-75ad-491b-a27a-c62858f32053+3:16511:x1874190446730752:12345-0@lo:104: Request processed in 49us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.664368:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787367680.664405:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787367680.664410:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664416:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb2a75600 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1787367680.664418:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664425:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367680.664438:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367680.664443:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787367680.664463:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664469:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787367680.664475:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664481:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8fb2a75600/0xcbf1f1bac53f4846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f484d expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664491:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367680.664494:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664500:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5ea00 already unused, calling callback (ffffffffc1ccec20) 10000000:00010000:2.0:1787367680.664503:0:14364:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664510:0:14364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787367680.664516:0:14364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787367680.664522:0:14364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787367680.664542:0:14364:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.664549:0:14364:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787367680.664688:0:16511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730624:0@lo:104: 00000100:00100000:3.0:1787367680.664709:0:16511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730752:0@lo:104: 00010000:00010000:3.0:1787367680.664732:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367680.665395:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446731136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787367680.665447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787367680.665672:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.665683:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9e8f82b5ea00/0xcbf1f1bac53f47f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcbf1f1bac53f4800 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.665712:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367680.665714:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367680.665716:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787367680.666102:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446730880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367680.666139:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367680.666169:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787367680.666176:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446731008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367680.666225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367680.666266:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731136 00000100:00100000:1.0:1787367680.666272:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731136 00010000:00010000:1.0:1787367680.666304:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 19 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367680.666323:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446730880 00000100:00100000:1.0:1787367680.666326:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446730880 00010000:00010000:1.0:1787367680.666338:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 20 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367680.666348:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731008 00000100:00100000:1.0:1787367680.666351:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731008 00010000:00010000:1.0:1787367680.666361:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 21 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367680.666373:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787367680.666380:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74b4a5c6-75ad-491b-a27a-c62858f32053+21:3310:x1874190446731136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787367680.666395:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367680.666400:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 21 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367680.666424:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 21 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367680.666443:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb2a74600/0xcbf1f1bac53f4800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f47f9 expref: 21 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367680.666458:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367680.666532:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787367680.666542:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787367680.666680:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367680.666688:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+20:3312:x1874190446730880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367680.666707:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367680.666713:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 20 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666722:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 20 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666732:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb2a74e00/0xcbf1f1bac53f4981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f497a expref: 20 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666741:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367680.666774:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446730880:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367680.666781:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787367680.666798:0:14361:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787367680.666805:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367680.666811:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+18:3312:x1874190446731008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787367680.666818:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367680.666822:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666830:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666854:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fb357e200/0xcbf1f1bac53f484d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcbf1f1bac53f4846 expref: 18 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.666862:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367680.666886:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:3312:x1874190446731008:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367680.666893:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787367680.667382:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446731008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787367680.667393:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446730880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787367680.670831:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74b4a5c6-75ad-491b-a27a-c62858f32053+16:3310:x1874190446731136:12345-0@lo:103:ldlm_bl.0 Request processed in 4428us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367680.671252:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787367680.671825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367680.671935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367680.671971:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767040 00000100:00100000:2.0:1787367680.671982:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767040 00010000:00010000:2.0:1787367680.672489:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 13 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.672538:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425766912 00000100:00100000:2.0:1787367680.672542:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425766912 00010000:00010000:2.0:1787367680.672618:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 14 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367680.672644:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1787367680.672655:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ffb7871-5095-4de5-b072-071bd98a5440+14:2356:x1874190425767040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367680.672672:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367680.672679:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 14 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672728:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 14 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672757:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367680.672829:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ffb7871-5095-4de5-b072-071bd98a5440+14:2356:x1874190425767040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 176us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.672848:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1787367680.672868:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:2.0:1787367680.672875:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ffb7871-5095-4de5-b072-071bd98a5440+13:2356:x1874190425766912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367680.672883:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367680.672888:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 13 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672899:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 13 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672913:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672923:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672942:0:14361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672949:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672956:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672970:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672978:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496200 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367680.672982:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.672992:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367680.673003:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367680.673394:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74b4a5c6-75ad-491b-a27a-c62858f32053:3310:1874190446731136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787367680.673652:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367680.673705:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ffb7871-5095-4de5-b072-071bd98a5440+13:2356:x1874190425766912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 818us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367680.673715:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:0.0:1787367680.675973:0:16511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fbf598a00/0xcbf1f1bac53f4adf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e4b expref: 12 pid: 14370 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367680.675999:0:16511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730240:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367680.676015:0:16511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8fbf598000/0xcbf1f1bac53f4aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5de9 expref: 11 pid: 14369 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367680.676023:0:16511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3475180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16511:1874190446730368:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367680.676071:0:16511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.676081:0:16511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.676087:0:16511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367680.676093:0:16511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e8f81496200/0xcbf1f1bac53f4b09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.542563:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787367681.733103:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367681.733115:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f918f1000 from 10 10000000:01000000:3.0:1787367681.733123:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367681.733186:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.733215:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.733242:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367681.733276:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.733372:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367681.733517:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.733535:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731264 00000100:00100000:2.0:1787367681.733554:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731264 00000100:00100000:2.0:1787367681.733621:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787367681.733633:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+16:14373:x1874190446731264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367681.733650:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367681.733668:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f4b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4b10 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.733705:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f4b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b10 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.733729:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81497800/0xcbf1f1bac53f4b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b10 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.733740:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497800, rc 0) 00000100:00100000:2.0:1787367681.733789:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.733796:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787367681.734071:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367681.734088:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b17 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.734097:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4b17 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367681.734161:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.734211:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367681.734235:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.734289:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731392 00000100:00100000:2.0:1787367681.734294:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731392 00000100:00100000:2.0:1787367681.734325:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787367681.734332:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.734782:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.734790:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787367681.735059:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.735106:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.735150:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367681.735181:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787367681.735223:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731520 00000100:00100000:3.0:1787367681.735227:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731520 00000100:00100000:3.0:1787367681.735256:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787367681.735263:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.735740:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 475us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367681.735755:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787367681.735807:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787367681.739959:0:16550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787367681.740310:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787367681.740338:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787367681.740354:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b17 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.740367:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357e800/0xcbf1f1bac53f4b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b17 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787367681.740379:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787367681.740382:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8f92201800 from 10 10000000:01000000:3.0:1787367681.740385:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787367681.740437:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.740446:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.740459:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367681.740558:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.740652:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367681.740720:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.740776:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731648 00000100:00100000:2.0:1787367681.740786:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731648 00000100:00100000:2.0:1787367681.740914:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787367681.740927:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+17:14373:x1874190446731648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367681.740945:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367681.741053:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f4b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4b1e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.741089:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f4b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b1e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.741117:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496a00/0xcbf1f1bac53f4b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b1e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.741128:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496a00, rc 0) 00000100:00100000:2.0:1787367681.741299:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446731648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 375us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.741307:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787367681.741481:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787367681.741499:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b25 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367681.741509:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4b25 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367681.741585:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367681.741614:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367681.741690:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f863e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.741722:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731776 00000100:00100000:2.0:1787367681.741727:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731776 00000100:00100000:2.0:1787367681.741789:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787367681.741799:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446731776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.742269:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446731776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 470us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.742277:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787367681.742299:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787367681.742713:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367681.742772:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367681.742797:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446731904 00000100:00100000:2.0:1787367681.742804:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446731904 00000100:00100000:1.0:1787367681.742812:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa01bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.742842:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787367681.742850:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446731904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.743159:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446731904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.743167:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787367681.745839:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446731904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787367681.750271:0:16553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787367681.751736:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787367681.751772:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787367681.751786:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b25 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367681.751801:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb357fe00/0xcbf1f1bac53f4b1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b25 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787367681.751814:0:14373:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787367681.751818:0:14373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e8fbaec6800 from 10 10000000:01000000:0.0:1787367681.751821:0:14373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787367681.751870:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367681.751879:0:14373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367681.751891:0:14373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367681.751924:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787367681.752016:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367681.752079:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.752389:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446732032 00000100:00100000:2.0:1787367681.752399:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446732032 00000100:00100000:2.0:1787367681.752466:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787367681.752480:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+18:14373:x1874190446732032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367681.752512:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367681.752528:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f4b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbf1f1bac53f4b2c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.752559:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f4b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b2c expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.752572:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496e00/0xcbf1f1bac53f4b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcbf1f1bac53f4b2c expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.752582:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496e00, rc 0) 00000100:00100000:2.0:1787367681.752771:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446732032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.752779:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787367681.757432:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787367681.757485:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b33 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367681.757502:0:14373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcbf1f1bac53f4b33 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367681.757614:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367681.757719:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367681.757779:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa1e3c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.758259:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446732160 00000100:00100000:2.0:1787367681.758267:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446732160 00000100:00100000:2.0:1787367681.758333:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787367681.758344:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbc0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446732160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.758748:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbc0e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446732160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.758759:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787367681.758816:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.758862:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.758909:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367681.758930:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fb8989900 going to sleep for 11 seconds 00000100:00100000:2.0:1787367681.758946:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446732288 00000100:00100000:2.0:1787367681.758950:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446732288 00000100:00100000:2.0:1787367681.758980:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787367681.758987:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446732288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787367681.759153:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:14373:x1874190446732288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367681.759160:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787367681.759231:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3476300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74b4a5c6-75ad-491b-a27a-c62858f32053:14373:1874190446732288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787367681.759903:0:16555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787367681.759978:0:14373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787367681.760002:0:14373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787367681.760013:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b33 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367681.760026:0:14373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9e8fb571ce00/0xcbf1f1bac53f4b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcbf1f1bac53f4b33 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787367681.927008:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787367682.247835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367682.254401:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767168 00000100:00100000:2.0:1787367682.254424:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767168 00000100:00100000:2.0:1787367682.254521:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:2.0:1787367682.254534:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+11:13789:x1874190425767168:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787367682.254558:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367682.254590:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f4b3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5e7c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367682.254630:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f4b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e7c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367682.254644:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f81496600/0xcbf1f1bac53f4b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e7c expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367682.254680:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496600, rc 0) 00000100:00100000:2.0:1787367682.255276:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767168:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 742us (7448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367682.255285:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:1.0:1787367682.273842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367682.274069:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767296 00000100:00100000:0.0:1787367682.274083:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767296 00000100:00100000:0.0:1787367682.274159:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:0.0:1787367682.274172:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767296:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787367682.274593:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767296:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 421us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367682.274604:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:1.0:1787367682.283541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367682.283646:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767424 00000100:00100000:3.0:1787367682.283660:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767424 00000100:00100000:3.0:1787367682.283780:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1787367682.283793:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767424:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787367682.284189:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767424:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 398us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367682.284228:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1787367682.295256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367682.295373:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767552 00000100:00100000:1.0:1787367682.295390:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767552 00000100:00100000:1.0:1787367682.295476:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:1.0:1787367682.295488:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f908ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+12:13789:x1874190425767552:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787367682.295513:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367682.295537:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f4b41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55172587972d5e83 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367682.295589:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f4b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e83 expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367682.295605:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e8f82b5e200/0xcbf1f1bac53f4b41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e83 expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367682.295618:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e200, rc 0) 00000100:00100000:1.0:1787367682.295716:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f908ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:13789:x1874190425767552:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 230us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367682.295725:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:2.0:1787367682.299115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367682.299286:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767680 00000100:00100000:3.0:1787367682.299301:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767680 00000100:00100000:3.0:1787367682.299365:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:3.0:1787367682.299377:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+13:13789:x1874190425767680:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787367682.299824:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ffb7871-5095-4de5-b072-071bd98a5440+13:13789:x1874190425767680:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 446us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367682.299835:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:3.0:1787367682.302449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367682.302688:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767808 00000100:00100000:1.0:1787367682.302702:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767808 00000100:00100000:1.0:1787367682.302776:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:1.0:1787367682.302789:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:13789:x1874190425767808:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787367682.303133:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:13789:x1874190425767808:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 345us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367682.303143:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00010000:00010000:3.0:1787367682.565647:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367683.593227:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367683.847250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367683.847306:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367683.847338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367683.847465:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768192 00000100:00100000:3.0:1787367683.847478:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768192 00000100:00100000:3.0:1787367683.847565:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1787367683.847578:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425768192:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367683.847724:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425768192:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367683.847733:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1787367683.848187:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425767936 00000100:00100000:1.0:1787367683.848219:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425767936 00000100:00100000:1.0:1787367683.848256:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:1.0:1787367683.848264:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa01e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:2358:x1874190425767936:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367683.848308:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa01e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ffb7871-5095-4de5-b072-071bd98a5440+13:2358:x1874190425767936:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 45us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367683.848316:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00080000:1.0:1787367683.848358:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367683.850309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367683.850908:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367683.851899:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768704 00000100:00100000:1.0:1787367683.851915:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768704 00000100:00100000:1.0:1787367683.852007:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1787367683.852019:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2358:x1874190425768704:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:3.0:1787367683.852566:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787367683.853590:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2358:x1874190425768704:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 1565us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367683.853603:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1787367683.854543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367683.854571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367683.854602:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768320 00000100:00100000:2.0:1787367683.854612:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768320 00000100:00100000:1.0:1787367683.854758:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768576 00000100:00100000:1.0:1787367683.854763:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768576 00000100:00100000:2.0:1787367683.854881:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1787367683.854891:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425768320:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367683.854962:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425768320:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367683.854969:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1787367683.855037:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:1.0:1787367683.855044:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2358:x1874190425768576:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1787367683.855088:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2358:x1874190425768576:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 44us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367683.855094:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1787367683.855918:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768448 00000100:00100000:0.0:1787367683.855927:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768448 00000100:00100000:0.0:1787367683.855976:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768064 00000100:00100000:0.0:1787367683.855980:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768064 00000100:00100000:0.0:1787367683.856009:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1787367683.856018:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2358:x1874190425768448:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367683.856076:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2358:x1874190425768448:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 60us (8737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367683.856084:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1787367683.856113:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1787367683.856121:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2358:x1874190425768064:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367683.856150:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2358:x1874190425768064:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 30us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367683.856179:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00080000:2.0:1787367683.858659:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787367683.858673:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787367683.858677:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367684.469349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367684.474479:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425768832 00000100:00100000:0.0:1787367684.474506:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425768832 00000100:00100000:0.0:1787367684.474738:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1787367684.474750:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:14447:x1874190425768832:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787367684.474943:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367684.475047:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e8a expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475249:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475271:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475287:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475306:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475315:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.475323:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.476374:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d800/0xcbf1f1bac53f4b5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.476407:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d800/0xcbf1f1bac53f4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.476418:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d800/0xcbf1f1bac53f4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367684.476514:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787367684.477262:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367684.477424:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d800/0xcbf1f1bac53f4b5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477444:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477452:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477460:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477468:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571c200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367684.477473:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477482:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.477499:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:0.0:1787367684.477504:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367684.477511:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481736:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481831:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481839:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481847:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481853:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571c000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367684.481858:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481866:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481887:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e8f83c18a00) 00010000:00010000:0.0:1787367684.481891:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367684.481898:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.481903:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4b56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.482126:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e8a expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.482342:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d800/0xcbf1f1bac53f4b5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e8a expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.482350:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18400) 00010000:00010000:0.0:1787367684.482353:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787367684.482356:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb571d800, rc 0) 00000100:00100000:0.0:1787367684.482478:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:14447:x1874190425768832:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 7727us (13141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367684.482489:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1787367684.491666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.491894:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769088 00000100:00100000:1.0:1787367684.491908:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769088 00000100:00100000:1.0:1787367684.491993:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1787367684.492006:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:14447:x1874190425769088:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367684.492038:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367684.492070:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e91 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.492238:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.492258:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.492297:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.496237:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.496268:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.496283:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497294:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4b79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497310:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497321:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367684.497332:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787367684.497797:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497807:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497815:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.497823:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367684.497835:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498666:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498684:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e8f83c18400) 00010000:00010000:1.0:1787367684.498687:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367684.498693:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498701:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4b6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498719:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498727:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498734:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498739:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367684.498742:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498748:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498754:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e8f86d97700) 00010000:00010000:1.0:1787367684.498757:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367684.498769:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.498776:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4b72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.503567:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e91 expref: 10 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.503598:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f200/0xcbf1f1bac53f4b79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e91 expref: 9 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.503607:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97d00) 00010000:00010000:1.0:1787367684.503610:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367684.503614:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f200, rc 0) 00000100:00100000:1.0:1787367684.503691:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14447:x1874190425769088:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 11687us (12046us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787367684.503700:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1787367684.508582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367684.509270:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769216 00000100:00100000:0.0:1787367684.509285:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769216 00000100:00100000:0.0:1787367684.509363:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:0.0:1787367684.509376:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14447:x1874190425769216:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787367684.509555:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14447:x1874190425769216:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 179us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367684.509566:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1787367684.564391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367684.564592:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769344 00000100:00100000:3.0:1787367684.564607:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769344 00000100:00100000:3.0:1787367684.564705:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:3.0:1787367684.564719:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14453:x1874190425769344:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367684.564749:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367684.564793:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e98 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564895:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564912:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564928:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564946:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564954:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.564961:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565395:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565406:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565413:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565420:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.565426:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565435:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565451:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:3.0:1787367684.565455:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.565462:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565468:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565483:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565490:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565495:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565507:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.565510:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565517:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565526:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e8f91b61000) 00010000:00010000:3.0:1787367684.565529:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.565532:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565538:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565578:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4b87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e98 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565590:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:3.0:1787367684.565593:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.565597:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e98 expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.565607:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357fc00, rc 0) 00000100:00100000:3.0:1787367684.565743:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14453:x1874190425769344:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1025us (1366us total) trans 0 rc 301/301 00000100:00100000:3.0:1787367684.565752:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:3.0:1787367684.577561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.577911:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769472 00000100:00100000:1.0:1787367684.577927:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769472 00000100:00100000:1.0:1787367684.577999:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367684.578010:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14453:x1874190425769472:12345-192.168.204.23@tcp:700:lfs.0 00000100:00100000:1.0:1787367684.578126:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14453:x1874190425769472:12345-192.168.204.23@tcp:700:lfs.0 Request processed in 118us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367684.578134:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1787367684.584767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.584889:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769728 00000100:00100000:1.0:1787367684.584900:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769728 00000100:00100000:1.0:1787367684.588524:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1787367684.588560:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14453:x1874190425769728:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:1.0:1787367684.588655:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367684.588709:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf599a00/0xcbf1f1bac53f4aca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e13 expref: 9 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.588733:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:1.0:1787367684.588738:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367684.589710:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.589735:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 5 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.589745:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.589791:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 5 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.589810:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 5 pid: 14378 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367684.589825:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14378:1874190446732416:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367684.590003:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f92242480 going to sleep for 11 seconds 00000100:00100000:1.0:1787367684.600479:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14378:1874190446732416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367684.600513:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367684.605171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.605380:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769856 00000100:00100000:2.0:1787367684.605419:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769856 00010000:00010000:2.0:1787367684.605483:0:14361:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 6 pid: 14378 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367684.605535:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1787367684.605547:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2356:x1874190425769856:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367684.605903:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367684.605912:0:14361:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 6 pid: 14378 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.605928:0:14361:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 6 pid: 14378 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.605960:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fbf598e00/0xcbf1f1bac53f4b02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5e75 expref: 6 pid: 14378 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.605983:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:2.0:1787367684.605989:0:14361:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.605999:0:14361:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.606008:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.606048:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367684.606111:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2356:x1874190425769856:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 566us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367684.606130:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00010000:00010000:1.0:1787367684.606223:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.606239:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.606268:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.606278:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.606286:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367684.608053:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787367684.608070:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608079:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608086:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608092:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367684.608097:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608104:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608120:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f83c18c00) 00010000:00010000:1.0:1787367684.608123:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367684.608137:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.608143:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4b9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367684.608165:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f334472f reply state 00000000fe505dfe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367684.608174:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367684.608330:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:14453:x1874190425769728:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 19788us (23569us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787367684.608339:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:2.0:1787367684.611531:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787367684.613174:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613229:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613237:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613244:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.613249:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613259:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613275:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e8f86d97700) 00010000:00010000:3.0:1787367684.613279:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.613284:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.613290:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4ba3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367684.675847:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787367684.675873:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8f904a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446732544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787367684.675950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367684.676075:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446732544 00000100:00100000:2.0:1787367684.676084:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446732544 00000100:00100000:2.0:1787367684.676150:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787367684.676159:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446732544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787367684.676219:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787367684.676273:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446732544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367684.676281:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787367684.676431:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787367684.676470:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8f904a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446732544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787367684.699104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.699268:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425769984 00000100:00100000:2.0:1787367684.699285:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425769984 00000100:00100000:2.0:1787367684.699371:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:2.0:1787367684.699382:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:14461:x1874190425769984:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:2.0:1787367684.699407:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367684.699431:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5e9f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699514:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496200/0xcbf1f1bac53f4bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699530:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496200/0xcbf1f1bac53f4bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699542:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496200/0xcbf1f1bac53f4bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367684.699763:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787367684.699783:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367684.699837:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496200/0xcbf1f1bac53f4bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699869:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e9f expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699892:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496200/0xcbf1f1bac53f4bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5e9f expref: 10 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.699902:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:2.0:1787367684.699904:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787367684.699908:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496200, rc 0) 00000100:00100000:2.0:1787367684.699980:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:14461:x1874190425769984:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 600us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367684.700640:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:0.0:1787367684.732050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367684.732356:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425770112 00000100:00100000:3.0:1787367684.732370:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425770112 00000100:00100000:3.0:1787367684.732469:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1787367684.732863:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+5:14462:x1874190425770112:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367684.732890:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367684.732918:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ea6 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733016:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733035:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733051:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367684.733145:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787367684.733150:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367684.733184:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733263:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ea6 expref: 7 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733284:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357fc00/0xcbf1f1bac53f4bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ea6 expref: 6 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.733295:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:3.0:1787367684.733298:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367684.733303:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357fc00, rc 0) 00000100:00100000:3.0:1787367684.733382:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+6:14462:x1874190425770112:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 524us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367684.739001:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1787367684.741947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367684.742146:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425770240 00000100:00100000:3.0:1787367684.742159:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425770240 00000100:00100000:3.0:1787367684.742279:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:3.0:1787367684.742292:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+6:14462:x1874190425770240:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367684.742322:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367684.742350:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ead expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742462:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742488:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742503:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742520:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742536:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742543:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742694:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742702:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742710:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367684.742773:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787367684.742778:0:16500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787367684.742804:0:16500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742819:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742826:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742834:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742841:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.742846:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742855:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742872:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:3.0:1787367684.742875:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.742881:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742888:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742904:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742921:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742928:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742933:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.742937:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742944:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742952:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e8f91b61000) 00010000:00010000:3.0:1787367684.742955:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.742958:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742964:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.742999:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ead expref: 8 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.743013:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ead expref: 7 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.743021:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f91b61d00) 00010000:00010000:3.0:1787367684.743024:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787367684.743046:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f600, rc 0) 00000100:00100000:3.0:1787367684.743124:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+7:14462:x1874190425770240:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 833us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367684.743133:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1787367684.752719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.752934:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425770496 00000100:00100000:1.0:1787367684.752948:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425770496 00000100:00100000:1.0:1787367684.753032:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:1.0:1787367684.753044:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+7:14462:x1874190425770496:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367684.753075:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367684.753101:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5eb4 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367684.753307:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787367684.753487:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4be2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5eb4 expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.753507:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:1.0:1787367684.753511:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367684.753517:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5eb4 expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.753557:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00100000:1.0:1787367684.754323:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+8:14462:x1874190425770496:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1275us (1614us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787367684.754336:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1787367684.758825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367684.758986:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425770752 00000100:00100000:3.0:1787367684.759000:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425770752 00000100:00100000:3.0:1787367684.759083:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:3.0:1787367684.759097:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+8:14462:x1874190425770752:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:3.0:1787367684.759189:0:16500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787367684.759258:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f600/0xcbf1f1bac53f4bdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ead expref: 8 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.759282:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f91b61d00) 00010000:00010000:3.0:1787367684.759295:0:16500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787367684.759331:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.759348:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.759360:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787367684.759699:0:16500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d19f2938 reply state 00000000fa02f962 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367684.759711:0:16500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787367684.759727:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787367684.759850:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+9:14462:x1874190425770752:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 755us (1040us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787367684.759881:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:1.0:1787367684.764314:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764339:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764348:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764356:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357ea00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367684.764361:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764370:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764391:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f91b61000) 00010000:00010000:1.0:1787367684.764395:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787367684.764400:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.764406:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357ea00/0xcbf1f1bac53f4bf0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367684.764834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.765342:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771008 00000100:00100000:2.0:1787367684.765355:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771008 00000100:00100000:2.0:1787367684.765425:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:2.0:1787367684.765438:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+8:14462:x1874190425771008:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367684.766399:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+9:14462:x1874190425771008:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 955us (1563us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787367684.766413:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1787367684.770548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367684.770647:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771264 00000100:00100000:3.0:1787367684.770661:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771264 00000100:00100000:3.0:1787367684.770751:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1787367684.770765:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+9:14462:x1874190425771264:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1787367684.770799:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787367684.770827:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ebb expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.770932:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.770952:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.770965:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.770982:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.770990:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771002:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787367684.771179:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787367684.771330:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771347:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771354:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771361:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357e200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.771366:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771375:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771391:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:3.0:1787367684.771395:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.771402:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771962:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357e200/0xcbf1f1bac53f4bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771983:0:14376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771990:0:14376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.771996:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.772002:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367684.772861:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.772880:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.772899:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e8f91b61400) 00010000:00010000:3.0:1787367684.772902:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367684.772907:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.772914:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4c05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.772992:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ebb expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.773004:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:3.0:1787367684.773006:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787367684.773010:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f400/0xcbf1f1bac53f4bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ebb expref: 11 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367684.773345:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb357f400, rc 0) 00000100:00100000:2.0:1787367684.773914:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+10:14462:x1874190425771264:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3144us (3384us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787367684.773927:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1787367684.778085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.778209:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771392 00000100:00100000:1.0:1787367684.778224:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771392 00000100:00100000:1.0:1787367684.778309:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:1.0:1787367684.778322:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+10:14462:x1874190425771392:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367684.778358:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367684.778394:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ec2 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778713:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778732:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778747:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367684.778823:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787367684.778828:0:16500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787367684.778854:0:16500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778886:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 12 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778907:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 11 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.778917:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f86d97b00) 00010000:00010000:1.0:1787367684.778920:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787367684.778940:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f000, rc 0) 00000100:00100000:1.0:1787367684.779452:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+11:14462:x1874190425771392:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1130us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367684.779460:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:3.0:1787367684.783523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.783790:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771520 00000100:00100000:1.0:1787367684.783804:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771520 00000100:00100000:1.0:1787367684.783887:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367684.783901:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+11:14462:x1874190425771520:12345-192.168.204.23@tcp:37:lfs.0 00000100:00100000:1.0:1787367684.792490:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+11:14462:x1874190425771520:12345-192.168.204.23@tcp:37:lfs.0 Request processed in 8574us (8968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367684.792510:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:3.0:1787367684.798992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.799299:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771776 00000100:00100000:2.0:1787367684.799330:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771776 00000100:00100000:2.0:1787367684.799978:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1787367684.799996:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f9221c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+11:14462:x1874190425771776:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1787367684.800429:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f9221c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:270d9d40-a94a-419f-bb3a-a7459bf87377+12:14462:x1874190425771776:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 436us (1451us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787367684.800440:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:3.0:1787367684.869959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367684.870151:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425771904 00000100:00100000:0.0:1787367684.870166:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425771904 00000100:00100000:0.0:1787367684.870290:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:0.0:1787367684.870303:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:14468:x1874190425771904:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1787367684.870332:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787367684.870362:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571ca00/0xcbf1f1bac53f4c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ec9 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870458:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870490:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870505:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870522:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870708:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870717:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870866:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4c36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870875:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.870902:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367684.870945:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787367684.870949:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367684.870997:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871010:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871633:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871640:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871646:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571d200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367684.871651:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871659:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871675:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:0.0:1787367684.871679:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367684.871684:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871690:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871722:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871728:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871734:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871740:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571c200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367684.871743:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871749:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871757:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e8f83c18a00) 00010000:00010000:0.0:1787367684.871759:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367684.871763:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.871769:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c200/0xcbf1f1bac53f4c2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.872414:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571ca00/0xcbf1f1bac53f4c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec9 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.872436:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571c000/0xcbf1f1bac53f4c36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec9 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367684.872462:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f86d97b00) 00010000:00010000:0.0:1787367684.872465:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787367684.872468:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb571c000, rc 0) 00000100:00100000:0.0:1787367684.872885:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+11:14468:x1874190425771904:12345-192.168.204.23@tcp:101:bash.0 Request processed in 2581us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367684.872897:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1787367684.883389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367684.888115:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425772160 00000100:00100000:0.0:1787367684.888138:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425772160 00000100:00100000:1.0:1787367684.893226:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1787367684.893246:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+11:14468:x1874190425772160:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1787367684.893278:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367684.893308:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ed0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.893510:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.894000:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 11 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.894099:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.894163:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 11 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.894242:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 11 pid: 16500 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367684.894262:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb139f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14377:1874190446732672:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367684.894421:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f922429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787367684.897252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.897424:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425772288 00000100:00100000:2.0:1787367684.897438:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425772288 00010000:00010000:2.0:1787367684.897505:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 12 pid: 16500 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367684.897557:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1787367684.897567:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+12:2357:x1874190425772288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367684.897592:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367684.897600:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 12 pid: 16500 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.897630:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 12 pid: 16500 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.897659:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f86d97b00) 00010000:00010000:2.0:1787367684.897665:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.897678:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.897686:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.897727:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367684.897804:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+12:2357:x1874190425772288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 238us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367684.897813:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00010000:00010000:1.0:1787367684.899368:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4c1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ec2 expref: 11 pid: 16500 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367684.899402:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb139f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14377:1874190446732672:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367684.899430:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.899442:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.899448:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.899495:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.899510:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.899946:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.901512:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907064:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907084:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367684.907113:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787367684.907207:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907215:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907224:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907232:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:1.0:1787367684.907237:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907247:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907263:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f86d97b00) 00010000:00010000:1.0:1787367684.907266:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787367684.907272:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907279:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e000/0xcbf1f1bac53f4c44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367684.907303:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8508225 reply state 0000000030862599 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367684.907336:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787367684.907401:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907418:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 13 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367684.907426:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:1.0:1787367684.907428:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787367684.907431:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5fe00, rc 0) 00000100:00100000:1.0:1787367684.909186:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:14468:x1874190425772160:12345-192.168.204.23@tcp:101:bash.0 Request processed in 15927us (25795us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787367684.909227:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00010000:00010000:2.0:1787367684.915455:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.915724:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.915735:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.915741:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fa00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367684.915747:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.918382:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.918432:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e8f86d97200) 00010000:00010000:2.0:1787367684.918437:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787367684.918446:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.918455:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fa00/0xcbf1f1bac53f4c4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367684.936942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367684.937416:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425772416 00000100:00100000:2.0:1787367684.937432:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425772416 00000100:00100000:2.0:1787367684.937553:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1787367684.937567:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+13:14468:x1874190425772416:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1787367684.937604:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367684.937652:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ed7 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937759:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937777:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937789:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367684.937844:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787367684.937850:0:14376:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367684.937877:0:14376:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937890:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937920:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 15 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937946:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 14 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367684.937958:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367684.937968:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367684.937974:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496000, rc 0) 00000100:00100000:2.0:1787367684.938068:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:14468:x1874190425772416:12345-192.168.204.23@tcp:101:bash.0 Request processed in 504us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367684.938076:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:3.0:1787367684.941134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367684.941284:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425772672 00000100:00100000:1.0:1787367684.941296:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425772672 00000100:00100000:1.0:1787367684.941371:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367684.941384:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:14468:x1874190425772672:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1787367684.941928:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+15:14468:x1874190425772672:12345-192.168.204.23@tcp:35:bash.0 Request processed in 545us (812us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787367684.941938:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000040:00080000:1.0:1787367684.996563:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787367685.077947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367685.078076:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425772928 00000100:00100000:1.0:1787367685.078091:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425772928 00000100:00100000:1.0:1787367685.078236:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:1.0:1787367685.078250:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+15:14478:x1874190425772928:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1787367685.078299:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367685.078327:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ede expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367685.078495:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787367685.078695:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ede expref: 17 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.078714:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e8f8677c900) 00010000:00010000:1.0:1787367685.078717:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787367685.078723:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f600/0xcbf1f1bac53f4c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ede expref: 17 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.078743:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5f600, rc 0) 00000100:00080000:0.0:1787367685.079269:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367685.079386:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+16:14478:x1874190425772928:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1137us (1449us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787367685.079395:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:3.0:1787367685.086375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367685.086498:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425773184 00000100:00100000:1.0:1787367685.086510:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425773184 00000100:00100000:1.0:1787367685.086593:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1787367685.086605:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+16:14478:x1874190425773184:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1787367685.087007:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+17:14478:x1874190425773184:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 403us (647us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787367685.087017:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1787367685.142405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.142560:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425773440 00000100:00100000:2.0:1787367685.142574:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425773440 00000100:00100000:2.0:1787367685.142669:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1787367685.142682:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+17:14481:x1874190425773440:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1787367685.142718:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367685.142749:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ee5 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.142908:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4c83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.142928:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.142942:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367685.142955:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787367685.143141:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ee5 expref: 20 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.143166:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4c83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ee5 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.143273:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.143276:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367685.143280:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497e00, rc 0) 00000100:00100000:2.0:1787367685.143363:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:14481:x1874190425773440:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 684us (976us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787367685.143372:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:3.0:1787367685.147102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367685.147160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.147439:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425773568 00000100:00100000:2.0:1787367685.147454:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425773568 00000100:00100000:2.0:1787367685.147583:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:2.0:1787367685.147596:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:14481:x1874190425773568:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1787367685.147740:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147765:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147779:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147816:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147823:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147831:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147839:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367685.147869:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147878:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147913:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.147917:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367685.147923:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.147930:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367685.148041:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:14481:x1874190425773568:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 446us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367685.148052:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:0.0:1787367685.151268:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425773696 00000100:00100000:0.0:1787367685.151293:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425773696 00000100:00100000:0.0:1787367685.151387:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1787367685.151400:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:2358:x1874190425773696:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367685.151427:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367685.151465:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4c83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ee5 expref: 19 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.151506:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367685.151514:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367685.151605:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:2358:x1874190425773696:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 207us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.151627:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1787367685.152055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367685.152665:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425773952 00000100:00100000:1.0:1787367685.152675:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425773952 00000100:00100000:1.0:1787367685.152730:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1787367685.152773:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:14481:x1874190425773952:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1787367685.153098:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:14481:x1874190425773952:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 327us (1044us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787367685.153106:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1787367685.588864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.588990:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425774208 00000100:00100000:2.0:1787367685.589007:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425774208 00000100:00100000:2.0:1787367685.589110:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:2.0:1787367685.589122:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+19:14512:x1874190425774208:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1787367685.589156:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367685.589235:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5eec expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.589489:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.589509:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.589548:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367685.589563:0:14376:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787367685.589776:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4c98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5eec expref: 22 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.589804:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5eec expref: 21 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.589815:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.589818:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367685.589822:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496400, rc 0) 00000100:00100000:2.0:1787367685.589914:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:14512:x1874190425774208:12345-192.168.204.23@tcp:101:cat.0 Request processed in 793us (1060us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787367685.589924:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1787367685.593852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.594532:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425774336 00000100:00100000:2.0:1787367685.594554:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425774336 00000100:00100000:2.0:1787367685.594690:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1787367685.594703:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:2358:x1874190425774336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787367685.594733:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787367685.594769:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4c9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5eec expref: 21 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.594796:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.594805:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787367685.596093:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+20:2358:x1874190425774336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1380us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367685.596109:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:1.0:1787367685.598329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.598864:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425774592 00000100:00100000:2.0:1787367685.598878:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425774592 00000100:00100000:2.0:1787367685.599009:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:2.0:1787367685.599030:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+20:14512:x1874190425774592:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:2.0:1787367685.599542:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:14512:x1874190425774592:12345-192.168.204.23@tcp:35:cat.0 Request processed in 521us (1226us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787367685.599550:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:3.0:1787367685.636223:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787367685.667525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367685.667655:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425774848 00000100:00100000:1.0:1787367685.667666:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425774848 00000100:00100000:1.0:1787367685.667730:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:1.0:1787367685.667742:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:14518:x1874190425774848:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:1.0:1787367685.667772:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367685.667794:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4cad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5ef3 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.667921:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.667937:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.667946:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 22 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.667956:0:16500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.668005:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 22 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.668042:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 22 pid: 14376 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367685.668058:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446732800:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367685.668234:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.668250:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367685.668260:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb138e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446732928:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367685.668293:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fa0355900 going to sleep for 11 seconds 00000100:00100000:1.0:1787367685.671439:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446732800:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367685.671457:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb138e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446732928:192.168.204.23@tcp:104: 00010000:00010000:1.0:1787367685.671588:0:16500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367685.673695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367685.674216:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425774976 00000100:00100000:0.0:1787367685.674228:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425774976 00010000:00010000:0.0:1787367685.674277:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 23 pid: 14376 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367685.674341:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1787367685.674354:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+23:2357:x1874190425774976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367685.674371:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367685.674379:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 23 pid: 14376 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.674393:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 23 pid: 14376 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.674424:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4c67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed7 expref: 23 pid: 14376 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.674445:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367685.674450:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.674461:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.674482:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367685.674561:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+22:2357:x1874190425774976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 209us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.674569:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1787367685.678283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367685.678514:0:16514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425775104 00000100:00100000:0.0:1787367685.678525:0:16514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425775104 00010000:00010000:0.0:1787367685.678567:0:16514:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367685.678691:0:16514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1787367685.678702:0:16514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+22:2359:x1874190425775104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367685.678719:0:16514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367685.678728:0:16514:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678743:0:16514:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678773:0:16514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5fe00/0xcbf1f1bac53f4c52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5ed0 expref: 22 pid: 14377 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678789:0:16514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367685.678795:0:16514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678805:0:16514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678812:0:16514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.678863:0:16514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367685.678922:0:16514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:2359:x1874190425775104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 221us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.678930:0:16514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00010000:00010000:1.0:1787367685.678953:0:16500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.678966:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787367685.678988:0:16500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787367685.679424:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4cad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ef3 expref: 22 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.679458:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5e400/0xcbf1f1bac53f4cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5ef3 expref: 21 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367685.679476:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:1.0:1787367685.679479:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787367685.679482:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e400, rc 0) 00000100:00100000:1.0:1787367685.679526:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:14518:x1874190425774848:12345-192.168.204.23@tcp:101:dd.0 Request processed in 11787us (12013us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787367685.679534:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1787367685.681507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.681567:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425775360 00000100:00100000:2.0:1787367685.681577:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425775360 00000100:00100000:2.0:1787367685.681645:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:2.0:1787367685.681656:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+21:14518:x1874190425775360:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:2.0:1787367685.682068:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.682092:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.682105:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367685.682171:0:14376:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787367685.682255:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9e960d9 reply state 00000000f34bea22 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367685.682265:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787367685.682401:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f904a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14518:x1874190425775360:12345-192.168.204.23@tcp:36:dd.0 Request processed in 742us (898us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787367685.682424:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000020:00080000:2.0:1787367685.682430:0:14376:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787367685.685972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.686491:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425775488 00000100:00100000:2.0:1787367685.686506:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425775488 00000100:00100000:2.0:1787367685.686585:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1787367685.686596:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14518:x1874190425775488:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1787367685.686666:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367685.686694:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5efa expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.686777:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5efa expref: 25 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.686800:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5efa expref: 25 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.686830:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.686834:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367685.686838:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496c00, rc 0) 00000100:00100000:2.0:1787367685.686920:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+25:14518:x1874190425775488:12345-192.168.204.23@tcp:101:dd.0 Request processed in 325us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367685.686928:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00010000:00010000:0.0:1787367685.687222:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687256:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687266:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687273:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367685.687279:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687288:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687304:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367685.687307:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367685.687314:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.687321:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cc2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367685.698623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367685.698701:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425775744 00000100:00100000:0.0:1787367685.698712:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425775744 00000100:00100000:0.0:1787367685.698778:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1787367685.698787:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14518:x1874190425775744:12345-192.168.204.23@tcp:103:dd.0 00010000:00010000:0.0:1787367685.698802:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367685.698829:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5efa expref: 24 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367685.698878:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367685.698883:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367685.698939:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+23:14518:x1874190425775744:12345-192.168.204.23@tcp:103:dd.0 Request processed in 153us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.698947:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1787367685.699528:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367685.699580:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367685.699646:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733056 00000100:00100000:0.0:1787367685.699651:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733056 00000100:00100000:0.0:1787367685.699686:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787367685.699692:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446733056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367685.699720:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367685.699761:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446733056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.699767:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787367685.699789:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367685.699820:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb1c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787367685.700078:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74b4a5c6-75ad-491b-a27a-c62858f32053:3313:1874190446733184:0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700111:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367685.700150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446733696:0@lo:400:kworker.0 00000100:00100000:3.0:1787367685.700159:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446733312:0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367685.700220:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367685.700247:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787367685.700253:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446733440:0@lo:400:kworker.0 00000100:00100000:3.0:1787367685.700287:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733312 00000100:00100000:3.0:1787367685.700291:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733312 00000100:00100000:3.0:1787367685.700342:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367685.700352:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446733312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367685.700417:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733184 00000100:00100000:0.0:1787367685.700439:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446733568:0@lo:400:kworker.0 00000100:00100000:3.0:1787367685.700496:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446733312:12345-0@lo:400:kworker.0 Request processed in 146us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367685.700506:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787367685.700507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367685.700538:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446733312:0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700568:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733696 00000100:00100000:1.0:1787367685.700571:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733696 00000100:00100000:1.0:1787367685.700613:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733440 00000100:00100000:1.0:1787367685.700616:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733440 00000100:00100000:1.0:1787367685.700633:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367685.700639:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446733696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700671:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874190446733696:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367685.700678:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787367685.700699:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874190446733696:0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700729:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787367685.700734:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446733440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367685.700764:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874190446733440:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367685.700770:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787367685.700790:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874190446733440:0@lo:400:kworker.0 00000100:00080000:3.0:1787367685.700855:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787367685.702016:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733184 00000100:00100000:2.0:1787367685.702346:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787367685.702355:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367685.702357:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3313:x1874190446733184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367685.702415:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733568 00000100:00100000:2.0:1787367685.702418:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3313:x1874190446733184:12345-0@lo:400:kworker.0 Request processed in 64us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.702421:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733568 00000100:00100000:2.0:1787367685.702437:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1787367685.702449:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787367685.702489:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787367685.702492:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74b4a5c6-75ad-491b-a27a-c62858f32053:3313:1874190446733184:0@lo:400:kworker.0 00000100:00100000:0.0:1787367685.702500:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446733568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367685.702558:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446733568:12345-0@lo:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367685.702566:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787367685.702581:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446733568:0@lo:400:kworker.0 00000100:00100000:0.0:1787367685.704534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.705717:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425775872 00000100:00100000:2.0:1787367685.705729:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425775872 00000100:00100000:2.0:1787367685.705794:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:2.0:1787367685.705803:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+23:14518:x1874190425775872:12345-192.168.204.23@tcp:58:dd.0 00010000:00010000:2.0:1787367685.705906:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.705926:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.705939:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787367685.706670:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787367685.706831:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787367685.706895:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787367685.707031:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+23:14518:x1874190425775872:12345-192.168.204.23@tcp:58:dd.0 Request processed in 1225us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367685.707041:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1787367685.710891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367685.711073:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776000 00000100:00100000:2.0:1787367685.711085:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776000 00000100:00100000:2.0:1787367685.711166:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1787367685.711177:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+23:14518:x1874190425776000:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1787367685.713431:0:14376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367685.713546:0:14376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f01 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713623:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713639:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713661:0:14376:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713680:0:14376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713693:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367685.713697:0:14376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367685.713700:0:14376:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 24 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367685.713707:0:14376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496400, rc 0) 00000100:00100000:2.0:1787367685.714267:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14518:x1874190425776000:12345-192.168.204.23@tcp:101:dd.0 Request processed in 3089us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367685.714279:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000040:00080000:1.0:1787367686.020916:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787367686.020930:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787367686.021009:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787367686.021016:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787367686.021154:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb13b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874190446733824:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787367686.021296:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8fba81aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787367686.028472:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb13b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874190446733824:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787367686.036570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367686.036975:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776128 00000100:00100000:3.0:1787367686.036986:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776128 00000100:00100000:3.0:1787367686.037051:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1787367686.037062:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776128:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787367686.037171:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776128:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 Request processed in 111us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367686.037180:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367686.046920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.047021:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776256 00000100:00100000:2.0:1787367686.047032:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776256 00000100:00100000:2.0:1787367686.047106:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:2.0:1787367686.047117:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776256:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787367686.047165:0:14377:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787367686.047305:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776256:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 190us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.047314:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1787367686.067748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.069061:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776384 00000100:00100000:0.0:1787367686.069078:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776384 00000100:00100000:0.0:1787367686.069169:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:0.0:1787367686.069180:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776384:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787367686.069329:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069350:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069364:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069379:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069386:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069392:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069415:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069424:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069448:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787367686.069506:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787367686.069511:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787367686.069529:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069541:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069549:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069557:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069563:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571d200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.069569:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069577:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069614:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97d00) 00010000:00010000:0.0:1787367686.069617:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.069623:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069630:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d200/0xcbf1f1bac53f4cde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069657:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069665:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069670:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069676:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571dc00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.069679:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069685:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069694:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e8f83c18a00) 00010000:00010000:0.0:1787367686.069697:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.069700:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069706:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4ce5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069722:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069728:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069734:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069745:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571d600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.069748:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069754:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069763:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:0.0:1787367686.069765:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.069768:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.069774:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4cec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.069871:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776384:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 691us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367686.069880:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:0.0:1787367686.085879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.085970:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776640 00000100:00100000:2.0:1787367686.085985:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776640 00000100:00100000:2.0:1787367686.086071:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:2.0:1787367686.086084:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+24:14520:x1874190425776640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.086115:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367686.086155:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4cf3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f08 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086318:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086337:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086350:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367686.086363:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787367686.086503:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086512:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086519:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086544:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81497e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367686.086550:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086560:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086575:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367686.086578:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367686.086584:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086600:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4cfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086661:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4cf3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f08 expref: 26 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086673:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e8f86d97d00) 00010000:00010000:2.0:1787367686.086676:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787367686.086679:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4cf3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f08 expref: 26 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.086691:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81496000, rc 0) 00000100:00100000:2.0:1787367686.086782:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+25:14520:x1874190425776640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 701us (923us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787367686.086791:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1787367686.091999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.092150:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425776768 00000100:00100000:0.0:1787367686.092160:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425776768 00000100:00100000:0.0:1787367686.092260:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:0.0:1787367686.092270:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+25:14520:x1874190425776768:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787367686.092317:0:14378:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787367686.092463:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+25:14520:x1874190425776768:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 187us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367686.092471:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1787367686.098729:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.098846:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777024 00000100:00100000:2.0:1787367686.098871:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777024 00000100:00100000:2.0:1787367686.098937:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:2.0:1787367686.098950:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+25:14520:x1874190425777024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.098971:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367686.098994:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4d08 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f0f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787367686.101574:0:14377:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1787367686.101601:0:14377:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787367686.101708:0:14377:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787367686.102442:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4d0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.102481:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4d0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.102499:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4d0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.102586:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4d08 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f0f expref: 28 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.102624:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4d0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f0f expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.102637:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c100) 00010000:00010000:2.0:1787367686.102640:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787367686.102644:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f81497e00, rc 0) 00000100:00100000:2.0:1787367686.104729:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+27:14520:x1874190425777024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 5768us (5997us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787367686.104763:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:3.0:1787367686.123412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.123658:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777280 00000100:00100000:0.0:1787367686.123687:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777280 00000100:00100000:0.0:1787367686.123769:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:0.0:1787367686.123781:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+27:14520:x1874190425777280:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367686.123856:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367686.123888:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81497e00/0xcbf1f1bac53f4d0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f0f expref: 27 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.123912:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c100) 00010000:00010000:0.0:1787367686.123926:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787367686.123954:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.123969:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.123978:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.123993:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124000:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124007:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124105:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124113:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124125:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124132:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571d600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.124136:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124144:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124153:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e8f86d97b00) 00010000:00010000:0.0:1787367686.124156:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.124160:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124167:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d1d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124177:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124183:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124253:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124258:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571dc00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.124261:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124279:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124287:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x18b63f22 (ffff9e8f83c18a00) 00010000:00010000:0.0:1787367686.124290:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.124293:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.124299:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571dc00/0xcbf1f1bac53f4d24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x18b63f22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.124394:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+26:14520:x1874190425777280:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 615us (992us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787367686.124402:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:3.0:1787367686.129782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.129898:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777408 00000100:00100000:2.0:1787367686.129911:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777408 00000100:00100000:2.0:1787367686.129990:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1787367686.130003:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+26:14520:x1874190425777408:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.130026:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367686.130053:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4d2b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f16 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130129:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0a00/0xcbf1f1bac53f4d32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130146:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0a00/0xcbf1f1bac53f4d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130159:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0a00/0xcbf1f1bac53f4d32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130309:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496000/0xcbf1f1bac53f4d2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f16 expref: 28 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130331:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0a00/0xcbf1f1bac53f4d32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f16 expref: 27 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.130340:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.130343:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787367686.130346:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb6bb0a00, rc 0) 00000100:00100000:2.0:1787367686.130416:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+27:14520:x1874190425777408:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 415us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.130431:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1787367686.133907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.136882:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777664 00000100:00100000:0.0:1787367686.136903:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777664 00000100:00100000:0.0:1787367686.137000:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1787367686.137013:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+27:14520:x1874190425777664:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787367686.137580:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.137608:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.137621:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787367686.138116:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787367686.138130:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491413936829ns, next at 492413933571ns, rc = 0 00000004:00010000:0.0:1787367686.138282:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008432898c reply state 00000000c66aaed6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.138292:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787367686.138417:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+29:14520:x1874190425777664:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1404us (4518us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787367686.138427:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00010000:00010000:2.0:1787367686.141114:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141136:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141144:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141151:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571d600 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367686.141156:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141166:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141186:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.141227:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787367686.141233:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.141241:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb571d600/0xcbf1f1bac53f4d39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367686.142526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.142931:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777792 00000100:00100000:2.0:1787367686.142942:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777792 00000100:00100000:2.0:1787367686.143002:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:2.0:1787367686.143012:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+28:14520:x1874190425777792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.143046:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367686.143081:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f1d expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.143145:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 29 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.143160:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 29 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.143179:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.143182:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367686.143186:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb6bb1000, rc 0) 00000100:00100000:2.0:1787367686.143281:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+29:14520:x1874190425777792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 270us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.143289:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:0.0:1787367686.151700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.151807:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425777920 00000100:00100000:1.0:1787367686.151819:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425777920 00000100:00100000:1.0:1787367686.151900:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1787367686.151910:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2356:x1874190425777920:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787367686.152092:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787367686.152721:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2356:x1874190425777920:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 809us (1032us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787367686.152740:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1787367686.160232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.160370:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425778176 00000100:00100000:1.0:1787367686.160382:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425778176 00000100:00100000:1.0:1787367686.160476:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1787367686.160487:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+29:14520:x1874190425778176:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787367686.160791:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+30:14520:x1874190425778176:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 305us (604us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787367686.160801:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1787367686.166529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.166645:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425778432 00000100:00100000:2.0:1787367686.166656:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425778432 00000100:00100000:2.0:1787367686.166727:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:2.0:1787367686.166747:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+30:14520:x1874190425778432:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367686.166906:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+30:14520:x1874190425778432:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 170us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.166914:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1787367686.175065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.175233:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425778560 00000100:00100000:2.0:1787367686.175244:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425778560 00000100:00100000:2.0:1787367686.175310:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1787367686.175320:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+30:14520:x1874190425778560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.175344:0:16500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787367686.175385:0:16500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0c00/0xcbf1f1bac53f4d47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f24 expref: -99 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175483:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175500:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175512:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787367686.175551:0:16500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787367686.175570:0:16500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175638:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0c00/0xcbf1f1bac53f4d47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f24 expref: 32 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175660:0:16500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f24 expref: 31 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.175669:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.175672:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787367686.175675:0:16500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8fb6bb0600, rc 0) 00000100:00100000:2.0:1787367686.176008:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+31:14520:x1874190425778560:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 687us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.176016:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1787367686.185584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.185701:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425778688 00000100:00100000:1.0:1787367686.185714:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425778688 00000100:00100000:1.0:1787367686.185791:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:1.0:1787367686.185802:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2358:x1874190425778688:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787367686.185822:0:15063:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787367686.185847:0:15063:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x55172587972d5f2b expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367686.185876:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a891106, blocks: 0x1 00010000:00010000:1.0:1787367686.185896:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:1.0:1787367686.185901:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367686.185913:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 7 pid: 15063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.185936:0:15063:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 7 pid: 15063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.185953:0:15063:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e8f82b5e800, rc 0) 00000100:00100000:1.0:1787367686.186016:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:2358:x1874190425778688:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 217us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367686.186053:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1787367686.196133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.196381:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425778944 00000100:00100000:2.0:1787367686.196396:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425778944 00000100:00100000:2.0:1787367686.196512:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:2.0:1787367686.196523:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+31:14520:x1874190425778944:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787367686.196685:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+31:14520:x1874190425778944:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 164us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.196694:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1787367686.200682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.200785:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779072 00000100:00100000:1.0:1787367686.200796:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779072 00000100:00100000:1.0:1787367686.200857:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:1.0:1787367686.200868:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+31:14520:x1874190425779072:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787367686.320436:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:2.0:1787367686.346268:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+31:14520:x1874190425779072:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 145386us (145579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.346285:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000001:00080000:2.0:1787367686.346332:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1787367686.346339:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787367686.346366:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1787367686.346388:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:2.0:1787367686.346416:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787367686.347961:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446733952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787367686.348056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787367686.352639:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446733952 00000100:00100000:3.0:1787367686.352658:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446733952 00000100:00080000:1.0:1787367686.352819:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367686.353099:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787367686.353115:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446733952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787367686.353456:0:15064:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787367686.353461:0:15064:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787367686.353463:0:15064:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787367686.353465:0:15064:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787367686 -> 1787367686 00002000:00010000:3.0:1787367686.353468:0:15064:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787367686.353696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.353739:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787367686.353749:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787367686.353868:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779200 00000100:00100000:1.0:1787367686.353873:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779200 00000100:00100000:1.0:1787367686.353970:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1787367686.353980:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2356:x1874190425779200:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787367686.354069:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb13b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2356:x1874190425779200:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367686.354077:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1787367686.356723:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874190446733952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3598us (8651us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787367686.356757:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1787367686.357085:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e8fb2a58380/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787367686.357098:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446733952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787367686.361493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.361671:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779456 00000100:00100000:1.0:1787367686.361689:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779456 00000100:00100000:1.0:1787367686.361789:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:1.0:1787367686.361803:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:14520:x1874190425779456:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787367686.361879:0:14376:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787367686.361918:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0600/0xcbf1f1bac53f4d4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f24 expref: 14 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.361951:0:14376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:1.0:1787367686.361981:0:14376:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787367686.362028:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.362061:0:14376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.362076:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787367686.362409:0:14376:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a63e8597 reply state 000000008e8d433b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367686.362420:0:14376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787367686.362539:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e82067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+15:14520:x1874190425779456:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 738us (1059us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787367686.362548:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00010000:00010000:0.0:1787367686.367188:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367239:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367249:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367256:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f800 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:0.0:1787367686.367262:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367295:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367315:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:0.0:1787367686.367319:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787367686.367325:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.367332:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f800/0xcbf1f1bac53f4d5c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367686.369473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.369605:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779584 00000100:00100000:1.0:1787367686.369618:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779584 00000100:00100000:1.0:1787367686.369703:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1787367686.369717:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8e8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2359:x1874190425779584:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787367686.370022:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787367686.370027:0:15061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787367685 00002000:00010000:1.0:1787367686.370030:0:15061:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787367685 00002000:00010000:1.0:1787367686.370046:0:15061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787367686 -> 1787367685 00002000:00010000:1.0:1787367686.370049:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787367686.370141:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8e8340c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:2359:x1874190425779584:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 428us (686us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787367686.370151:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:0.0:1787367686.380315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.380522:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779712 00000100:00100000:2.0:1787367686.380536:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779712 00000100:00100000:2.0:1787367686.380634:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1787367686.380648:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:2357:x1874190425779712:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.380724:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380749:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367686.380755:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367686.380764:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380815:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380861:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380872:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380883:0:15063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380892:0:15063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb6bb1e00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367686.380899:0:15063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380910:0:15063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380930:0:15063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.380940:0:15063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1de0e70/0xcbf1f1bac53f4d63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367686.381100:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:2357:x1874190425779712:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 454us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367686.381110:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:3.0:1787367686.385638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.385739:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425779968 00000100:00100000:2.0:1787367686.385752:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425779968 00000100:00100000:2.0:1787367686.385809:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1787367686.385820:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:14520:x1874190425779968:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787367686.385904:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.385922:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.385933:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.386318:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.386330:0:16500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 15 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.386341:0:16500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.386383:0:16500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 15 pid: 16500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.386413:0:16500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 15 pid: 16500 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367686.386433:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446734080:192.168.204.23@tcp:104: 00000100:00100000:2.0:1787367686.386540:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367686.395906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1787367686.396140:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446734080:192.168.204.23@tcp:104: 00010000:00010000:2.0:1787367686.396174:0:16500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367686.401115:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780096 00000100:00100000:1.0:1787367686.401141:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780096 00010000:00010000:0.0:1787367686.405360:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 16 pid: 16500 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.405433:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1787367686.405446:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+16:2357:x1874190425780096:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367686.405468:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367686.405476:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 16 pid: 16500 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.405489:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 16 pid: 16500 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.405514:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1000/0xcbf1f1bac53f4d40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f1d expref: 16 pid: 16500 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.405551:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:0.0:1787367686.405558:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.405567:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.405575:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.406547:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367686.406635:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fa014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0bdbf83-8dcc-47ff-b097-a61c82195927+15:2357:x1874190425780096:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1188us (10743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367686.406647:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00010000:00010000:3.0:1787367686.411402:0:16500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.411426:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787367686.421482:0:16500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787367686.421662:0:16500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787367686.421712:0:16500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787367686.421845:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16500:1874190446734208:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787367686.421981:0:16500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367686.422020:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787367686.424882:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446734208 00000100:00100000:3.0:1787367686.424901:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446734208 00000100:00100000:3.0:1787367686.424972:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787367686.424983:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16500:x1874190446734208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787367686.425120:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16500:x1874190446734208:12345-0@lo:1000:mdt00_003.0 Request processed in 139us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367686.425128:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787367686.425521:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16500:1874190446734208:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787367686.426657:0:16500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787367686.426919:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16500:1874190446734336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787367686.426993:0:16500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367686.427093:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787367686.430403:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446734336 00000100:00100000:0.0:1787367686.430420:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446734336 00000100:00100000:0.0:1787367686.430964:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787367686.430978:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16500:x1874190446734336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787367686.431373:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16500:x1874190446734336:12345-0@lo:1000:mdt00_003.0 Request processed in 398us (4378us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787367686.431382:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787367686.433212:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16500:1874190446734336:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787367686.433262:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433274:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433301:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433307:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb6bb1e00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367686.433311:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433320:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433336:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.433340:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367686.433345:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433352:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb1e00/0xcbf1f1bac53f4d71 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433386:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433393:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433399:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433404:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f81496c00 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:2.0:1787367686.433407:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433423:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433432:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:2.0:1787367686.433434:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787367686.433441:0:16500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433466:0:16500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433475:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.433538:0:16500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496400/0xcbf1f1bac53f4cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f01 expref: 18 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367686.433553:0:16500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446734464:192.168.204.23@tcp:105: 00000100:00100000:2.0:1787367686.433785:0:16500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f904b4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787367686.439010:0:16500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16500:1874190446734464:192.168.204.23@tcp:105: 00010000:00010000:3.0:1787367686.439062:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439075:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f81496c00/0xcbf1f1bac53f4cd0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439115:0:16500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439129:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439141:0:16500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439152:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439179:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439186:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439227:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb357f200 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367686.439232:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439239:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439251:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:3.0:1787367686.439254:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787367686.439259:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439265:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb357f200/0xcbf1f1bac53f4d78 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439275:0:16500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439281:0:16500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439287:0:16500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439292:0:16500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb6bb0400 already unused, calling callback (ffffffffc20f04f0) 00010000:00010000:3.0:1787367686.439301:0:16500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439308:0:16500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439316:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e8f86d97900) 00010000:00010000:3.0:1787367686.439319:0:16500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787367686.439322:0:16500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367686.439328:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8fb6bb0400/0xcbf1f1bac53f4d6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367686.439601:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:14520:x1874190425779968:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 53781us (53976us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787367686.439613:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000020:00080000:3.0:1787367686.439620:0:16500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787367686.439849:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787367686.439855:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787367686.439882:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787367686.439890:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787367686.443894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367686.452239:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780224 00000100:00100000:3.0:1787367686.452260:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780224 00000100:00100000:3.0:1787367686.452345:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1787367686.452357:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91c49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:14518:x1874190425780224:12345-192.168.204.23@tcp:49:dd.0 00000100:00100000:3.0:1787367686.456217:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91c49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:14518:x1874190425780224:12345-192.168.204.23@tcp:49:dd.0 Request processed in 3835us (12308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367686.456238:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1787367686.460853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.461035:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780480 00000100:00100000:1.0:1787367686.461045:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780480 00000100:00100000:1.0:1787367686.461099:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1787367686.461119:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+18:14520:x1874190425780480:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787367686.461873:0:14380:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787367686.461984:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1787367686.462031:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462050:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462062:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462072:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462078:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462085:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.462105:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787367686.462232:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+20:14520:x1874190425780480:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 1110us (1384us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787367686.462242:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000020:00080000:1.0:1787367686.462247:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787367686.462458:0:14364:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787367686.462467:0:14364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.462475:0:14364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367686.462486:0:14364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.462495:0:14364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.462509:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e8f8677c600) 00010000:00010000:2.0:1787367686.462512:0:14364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787367686.462517:0:14364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.462523:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e8f82b5f000/0xcbf1f1bac53f4d7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.462536:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367686.462538:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367686.462540:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367686.598980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.599187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367686.599316:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780736 00000100:00100000:1.0:1787367686.599326:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780736 00000100:00100000:1.0:1787367686.599383:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780608 00000100:00100000:1.0:1787367686.599387:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780608 00000100:00100000:1.0:1787367686.599402:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780992 00000100:00100000:1.0:1787367686.599405:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780992 00000100:00100000:1.0:1787367686.599417:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425780864 00000100:00100000:1.0:1787367686.599420:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425780864 00000100:00100000:1.0:1787367686.599432:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781248 00000100:00100000:1.0:1787367686.599435:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781248 00000100:00100000:1.0:1787367686.599448:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781120 00000100:00100000:1.0:1787367686.599451:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781120 00000100:00100000:1.0:1787367686.599462:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781504 00000100:00100000:1.0:1787367686.599465:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781504 00000100:00100000:1.0:1787367686.599477:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781376 00000100:00100000:1.0:1787367686.599480:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781376 00000100:00100000:1.0:1787367686.599498:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1787367686.599508:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:2357:x1874190425780736:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:1.0:1787367686.599545:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.599564:0:15067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 14 pid: 15063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.599573:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367686.599577:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367686.599595:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.599634:0:15067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 14 pid: 15063 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.599660:0:15067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 14 pid: 15063 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367686.599677:0:15067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb139880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15067:1874190446734592:192.168.204.23@tcp:104: 00000100:00100000:1.0:1787367686.599774:0:15067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9e8f867ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787367686.607168:0:15067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb139880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15067:1874190446734592:192.168.204.23@tcp:104: 00010000:00010000:0.0:1787367686.607249:0:15067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367686.607502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1787367686.608032:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781632 00000100:00100000:0.0:1787367686.608045:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781632 00010000:00010000:0.0:1787367686.608095:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 15 pid: 15063 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.608148:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1787367686.608158:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+15:2358:x1874190425781632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787367686.608175:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787367686.608225:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 15 pid: 15063 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.608239:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 15 pid: 15063 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.608262:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f187228/0xcbf1f1bac53f4d55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x55172587972d5f2b expref: 15 pid: 15063 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.608279:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367686.608285:0:14362:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367686.608306:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.608315:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.608352:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787367686.608476:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0bdbf83-8dcc-47ff-b097-a61c82195927+14:2358:x1874190425781632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 317us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367686.608484:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00010000:00010000:1.0:1787367686.608596:0:15067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367686.608612:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.661623:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787367686.722446:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1787367686.722456:0:15067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787367685 -> 1787367686 00002000:00010000:2.0:1787367686.722459:0:15067:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787367685 -> 1787367686 00002000:00010000:2.0:1787367686.722461:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1787367686.722475:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722488:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722497:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722521:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5fc00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:2.0:1787367686.722526:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367686.722531:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:2.0:1787367686.722536:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787367686.722547:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:2.0:1787367686.722557:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722567:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ef58051/0xcbf1f1bac53f4d86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787367686.722734:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+12:2357:x1874190425780736:12345-192.168.204.23@tcp:4:dd.0 Request processed in 123214us (123750us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787367686.722750:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1787367686.722782:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1787367686.722794:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+11:2357:x1874190425780608:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:2.0:1787367686.722834:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x807 00010000:00010000:2.0:1787367686.722841:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722851:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787367686.722856:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787367686.722869:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787367686.722881:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367686.895808:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1787367686.896013:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1787367686.896030:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896042:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896051:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896058:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb6bb1a00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:0.0:1787367686.896063:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896073:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896095:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896120:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6e9683/0xcbf1f1bac53f4d8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787367686.896259:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+11:2357:x1874190425780608:12345-192.168.204.23@tcp:4:dd.0 Request processed in 173464us (297219us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787367686.896276:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1787367686.896316:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1787367686.896329:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:2357:x1874190425780992:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:0.0:1787367686.896371:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x1007 00010000:00010000:0.0:1787367686.896377:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896389:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1787367686.896394:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787367686.896400:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787367686.896412:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367687.006484:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1787367687.006647:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:1.0:1787367687.006652:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1787367687.006666:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006681:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006691:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006699:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8fb571cc00 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367687.006730:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006741:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006762:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.006770:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043548978/0xcbf1f1bac53f4d94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367687.006883:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:2357:x1874190425780992:12345-192.168.204.23@tcp:4:dd.0 Request processed in 110552us (407802us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787367687.006893:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1787367687.006929:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367687.006943:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:2357:x1874190425780864:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:1.0:1787367687.006990:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x1807 00010000:00010000:1.0:1787367687.006997:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.007012:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787367687.007017:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367687.007033:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.007046:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367687.131806:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787367687.131838:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.131855:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.131865:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.131873:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367687.131879:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.131961:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.131985:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.132156:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4d9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367687.132324:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+11:2357:x1874190425780864:12345-192.168.204.23@tcp:4:dd.0 Request processed in 125381us (533213us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787367687.132357:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1787367687.132395:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1787367687.132407:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+10:2357:x1874190425781248:12345-192.168.204.23@tcp:4:dd.0 00000001:00080000:0.0:1787367687.135380:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1787367687.136175:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x2007 00010000:00010000:1.0:1787367687.136189:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.136237:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787367687.136242:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367687.136249:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.136264:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367687.203255:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1787367687.203269:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00000001:00080000:0.0:1787367687.203277:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:1.0:1787367687.203288:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203301:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203310:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203356:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367687.203361:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203371:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203392:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203402:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4da2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367687.203727:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+8:2357:x1874190425781248:12345-192.168.204.23@tcp:4:dd.0 Request processed in 71199us (604482us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787367687.203739:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1787367687.203773:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367687.203784:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+7:2357:x1874190425781120:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:1.0:1787367687.203825:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x2807 00010000:00010000:1.0:1787367687.203832:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.203845:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787367687.203849:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367687.203862:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.204490:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787367687.249606:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1787367687.249633:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249647:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249657:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249665:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367687.249670:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249679:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249699:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249706:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4da9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367687.249852:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+9:2357:x1874190425781120:12345-192.168.204.23@tcp:4:dd.0 Request processed in 46066us (650694us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787367687.249863:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1787367687.249905:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1787367687.249918:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+8:2357:x1874190425781504:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:1.0:1787367687.249968:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x3007 00010000:00010000:1.0:1787367687.249975:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.249989:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787367687.250069:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367687.250076:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.250092:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787367687.250215:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:2.0:1787367687.292880:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1787367687.293802:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1787367687.293810:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1787367687.293827:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293844:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293876:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293884:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5f600 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:1.0:1787367687.293890:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293901:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293926:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.293936:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320d681d/0xcbf1f1bac53f4db0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787367687.294246:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+6:2357:x1874190425781504:12345-192.168.204.23@tcp:4:dd.0 Request processed in 44324us (695069us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787367687.294257:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1787367687.294303:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1787367687.294316:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2357:x1874190425781376:12345-192.168.204.23@tcp:4:dd.0 00002000:00010000:1.0:1787367687.294376:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a891106, atime: 0x6a891105, ctime: 0x6a891106, blocks: 0x3807 00010000:00010000:1.0:1787367687.294384:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.294411:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1787367687.294416:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787367687.294424:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787367687.294511:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787367687.349838:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1787367687.349954:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787367687.349972:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.349987:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.350235:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.350244:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e8f82b5e000 already unused, calling callback (ffffffffc16b1420) 00010000:00010000:3.0:1787367687.350250:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.350261:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.350283:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787367687.350292:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006090be04/0xcbf1f1bac53f4db7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787367687.350402:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2357:x1874190425781376:12345-192.168.204.23@tcp:4:dd.0 Request processed in 56085us (751208us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787367687.350418:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00010000:00010000:3.0:1787367687.685682:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787367688.710313:0:14364:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787367688.963275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367688.963932:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781760 00000100:00100000:3.0:1787367688.963945:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781760 00000100:00100000:3.0:1787367688.964025:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:3.0:1787367688.964036:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:2356:x1874190425781760:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367688.964136:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ffb7871-5095-4de5-b072-071bd98a5440+13:2356:x1874190425781760:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 102us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367688.964145:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:3.0:1787367688.994023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367688.994076:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425781888 00000100:00100000:3.0:1787367688.994086:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425781888 00000100:00100000:3.0:1787367688.994398:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:3.0:1787367688.994408:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+20:2358:x1874190425781888:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1787367688.994515:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+20:2358:x1874190425781888:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787367688.994523:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00080000:3.0:1787367688.994553:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787367688.999012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1787367688.999067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367688.999096:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425782016 00000100:00100000:3.0:1787367688.999106:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425782016 00000100:00100000:2.0:1787367688.999162:0:16630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425782144 00000100:00100000:2.0:1787367688.999168:0:16630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425782144 00000100:00100000:3.0:1787367688.999228:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1787367688.999240:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425782016:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:1.0:1787367688.999265:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787367688.999271:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787367688.999612:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425782016:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 373us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367689.003705:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1787367689.004398:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1787367689.004615:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fbb138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425782144:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367689.004735:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fbb138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0bdbf83-8dcc-47ff-b097-a61c82195927+5:2358:x1874190425782144:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 1012us (5667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367689.004751:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1787367689.017483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367689.017527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367689.017562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1787367689.017601:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425782400 00000100:00100000:3.0:1787367689.017610:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425782400 00000100:00100000:3.0:1787367689.017663:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425782528 00000100:00100000:3.0:1787367689.017666:0:15061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425782528 00000100:00100000:0.0:1787367689.018064:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1787367689.018078:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2356:x1874190425782400:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1787367689.018154:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2356:x1874190425782400:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 80us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367689.018161:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1787367689.018593:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190425782272 00000100:00100000:2.0:1787367689.018598:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190425782272 00000100:00100000:2.0:1787367689.018636:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1787367689.018644:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2356:x1874190425782272:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:0.0:1787367689.019410:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367689.019418:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787367689.019937:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:270d9d40-a94a-419f-bb3a-a7459bf87377+6:2356:x1874190425782272:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 1288us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367689.019949:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00080000:1.0:1787367689.027370:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787367689.040779:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1787367689.040806:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2356:x1874190425782528:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1787367689.041058:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fb3c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:270d9d40-a94a-419f-bb3a-a7459bf87377+5:2356:x1874190425782528:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 264us (23493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367689.041084:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000001:02000400:2.0:1787367689.247571:0:16668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787367689.732918:0:15518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367689.795503:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fb3c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446734720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787367689.795599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787367689.795764:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446734720 00000100:00100000:1.0:1787367689.795774:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446734720 00000100:00100000:1.0:1787367689.795859:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787367689.795869:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446734720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787367689.795907:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787367689.795956:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874190446734720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367689.795964:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787367689.796004:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787367689.796009:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e8fb2a58380, transno 8589934595 00000004:00080000:1.0:1787367689.796022:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787367689.796054:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fb3c81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874190446734720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787367689.797326:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787367690.755558:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787367690.822057:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446734848:0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.822175:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367690.822267:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446735360:0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.822300:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367690.822360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787367690.822367:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446734976:0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.822397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367690.822419:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446735488:0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.822441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367690.822473:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446735232:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.823166:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fba6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446735104:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.823228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367690.823254:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9e8fbb138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446735616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367690.823282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787367690.823323:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446734976 00000100:00100000:0.0:1787367690.823331:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446734976 00000100:00100000:0.0:1787367690.823402:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446735104 00000100:00100000:0.0:1787367690.823407:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446735104 00000100:00100000:0.0:1787367690.823445:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787367690.823456:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446734976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367690.823482:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446735360 00000100:00100000:1.0:1787367690.823494:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446735360 00000100:00100000:0.0:1787367690.823535:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874190446734976:12345-0@lo:400:kworker.0 Request processed in 80us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367690.823543:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446735488 00000100:00100000:0.0:1787367690.823545:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787367690.823548:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446735488 00000100:00100000:0.0:1787367690.823573:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367690.823580:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787367690.823586:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446735104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367690.823595:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446735360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.823631:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446735104:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367690.823639:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787367690.823662:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874190446735360:12345-0@lo:400:kworker.0 Request processed in 71us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367690.823670:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787367690.823695:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787367690.823701:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446735488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787367690.823733:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874190446735488:12345-0@lo:400:kworker.0 Request processed in 33us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787367690.823738:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787367690.823885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787367690.823940:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446734848 00000100:00100000:2.0:1787367690.823945:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446734848 00000100:00100000:2.0:1787367690.823991:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787367690.823999:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f91dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446734848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.824036:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f91dc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74b4a5c6-75ad-491b-a27a-c62858f32053+19:3312:x1874190446734848:12345-0@lo:400:kworker.0 Request processed in 38us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367690.824044:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787367690.824088:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446735232 00000100:00100000:2.0:1787367690.824092:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446735232 00000100:00100000:2.0:1787367690.824127:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787367690.824136:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446735232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787367690.824176:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8fba6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874190446735232:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787367690.824183:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787367690.824246:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874190446735232:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.824590:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874190446735616 00000100:00100000:0.0:1787367690.824604:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874190446735616 00000100:00100000:0.0:1787367690.824643:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787367690.824651:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446735616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787367690.824685:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787367690.824724:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e8f90840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874190446735616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787367690.824731:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787367690.824754:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787367690.824760:0:14372:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787367690.825012:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446735104:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.825151:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fbb138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874190446735616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787367690.825212:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874190446734976:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.825226:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874190446735488:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.825237:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74b4a5c6-75ad-491b-a27a-c62858f32053:3312:1874190446734848:0@lo:400:kworker.0 00000100:00100000:0.0:1787367690.825249:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9e8fba6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874190446735360:0@lo:400:kworker.0 Debug log: 29690 lines, 29690 kept, 0 dropped, 0 bad.